this post was submitted on 17 Nov 2023

1 points (100.0% liked)

LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

1

Introducing Tess: Tess-M with 200K Context Length (alien.top)

submitted 11 months ago by migtissera@alien.top to c/localllama@poweruser.forum

29 comments fedilink hide all child comments

I'm blown away. See for yourself.

https://migel.substack.com/p/a-conversation-with-tess

Tess, welcome to the world!

Model is Open Source with 200K context length.

Available at: https://huggingface.co/migtissera/Tess-M-v1.0

https://preview.redd.it/qehogf32mx0c1.jpg?width=800&format=pjpg&auto=webp&s=333356e7c95e1a1d8fc32dca1d7829720ad2cc84

you are viewing a single comment's thread
view the rest of the comments

[–] drifter_VR@alien.top 1 points 11 months ago (1 children)

Nice, did you manage to make a difference between Dolphin and Nous-Capybara ? Bothe are pretty close to me

[–] YearZero@alien.top 1 points 11 months ago (1 children)

Nope they're both really good and very close to each other in my tests: https://docs.google.com/spreadsheets/d/1NgHDxbVWJFolq8bLvLkuPWKC7i_R6I6W/edit?usp=sharing&ouid=102314596465921370523&rtpof=true&sd=true

[–] drifter_VR@alien.top 1 points 11 months ago (1 children)

Thanks, I remember your tests, it's great you are still on it.So according to your tests, 34b models compete with GPT3.5. I am not too surprised. And Mistral-7b is not so far behind, what a beast !
Will you benchmark 70b models too ?

[–] YearZero@alien.top 1 points 11 months ago

Unfortunately I don't have enough ram/gpu, and too broke right now to afford paying for extra! But in the future I hope I will