this post was submitted on 09 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

chat.lmsys.org is great. It has the best open source models, and it let's you control temperature and other parameters.

However, they have a limit on the message length that I can send to the LLM, something like 400 words, although the model supports much longer messages.

Do you happen to know alternatives that allow longer messages?

Thanks in advance!

you are viewing a single comment's thread
view the rest of the comments
[–] ammar-@alien.top 1 points 11 months ago (1 children)

Hey, I have a question please. Are you using the original models or quantized versions of them?

[–] cwl1907@alien.top 1 points 11 months ago (1 children)

All are original and no quantization at all, for fair comparison.

[–] ammar-@alien.top 1 points 11 months ago