LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

For Intel neuralchat or openhermes mistral 7b, what is the max output token size? (alien.top)

submitted 9 months ago by Shoddy_Vegetable_115@alien.top to c/localllama@poweruser.forum

0 comments fedilink hide all child comments

In fact, what is the total output token size for all model nowadays? Because I seem to have confused context length and output length. I figured that output length is usually fixed to 4k tokens. Is there such a limit to all models even the ones I mentioned? Because their model cards do not have any info on token limit.

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here