this post was submitted on 17 Nov 2023

1 points (100.0% liked)

LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

1

Introducing Tess: Tess-M with 200K Context Length (alien.top)

submitted 11 months ago by migtissera@alien.top to c/localllama@poweruser.forum

29 comments fedilink hide all child comments

I'm blown away. See for yourself.

https://migel.substack.com/p/a-conversation-with-tess

Tess, welcome to the world!

Model is Open Source with 200K context length.

Available at: https://huggingface.co/migtissera/Tess-M-v1.0

https://preview.redd.it/qehogf32mx0c1.jpg?width=800&format=pjpg&auto=webp&s=333356e7c95e1a1d8fc32dca1d7829720ad2cc84

you are viewing a single comment's thread
view the rest of the comments

[–] mcmoose1900@alien.top 1 points 11 months ago (1 children)

Almost the same syntax as Yi Capybara. Excellent.

I propose all Yi 34B 200K finetunes use Vincuna-ish prompt syntax, so they can ALL be merged into one hellish voltron model.

[–] mcmoose1900@alien.top 1 points 11 months ago (1 children)

The deed is done:

https://huggingface.co/brucethemoose/Capybara-Tess-Yi-34B-200K

Seems coherent in transformers, I'm gonna quant it to exl2 and test it out.

[–] SomeOddCodeGuy@alien.top 1 points 11 months ago

Just wanted to come back and let you know I started using this last night, and this is fantastic. I haven't put it through much testing yet, but just know that on initial use I'm very impressed by this model for general purpose AI assistant. It's keeping to the Assistant's more informal speech patterns while also answering questions well and keeping up with large context. Those are 3 checkboxes I've never been able to check at once. This praise wont' get much visibility since it's an older thread, but just wanted to let you know at least.