LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

Alternatives to chat.lmsys.org? (alien.top)

submitted 10 months ago by ammar-@alien.top to c/localllama@poweruser.forum

9 comments fedilink hide all child comments

chat.lmsys.org is great. It has the best open source models, and it let's you control temperature and other parameters.

However, they have a limit on the message length that I can send to the LLM, something like 400 words, although the model supports much longer messages.

Do you happen to know alternatives that allow longer messages?

Thanks in advance!

you are viewing a single comment's thread
view the rest of the comments

[–] cwl1907@alien.top 1 points 10 months ago (3 children)

Hey I'm one of the maintainers of chat.lmsys.org. We previously set this limit to avoid heavy compute but we are considering to increase it. how long is your input typically?

[–] ammar-@alien.top 1 points 10 months ago

Hey, thank you for replying! 400 words per message are good for most uses, but sometimes I need longer messages like 600 words for example. It's great that chat.lmsys.org has many great models and they get updated all the time, so it would be great to be able to use these models with longer messages. Thanks!

[–] ammar-@alien.top 1 points 10 months ago

And is there a plan to provide paid APIs for the available models that we can use programmatically, like OpenAI API?

[–] ammar-@alien.top 1 points 10 months ago (1 children)

Hey, I have a question please. Are you using the original models or quantized versions of them?

[–] cwl1907@alien.top 1 points 10 months ago (1 children)

All are original and no quantization at all, for fair comparison.

[–] ammar-@alien.top 1 points 10 months ago

Perfect!