this post was submitted on 28 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Using simple tree-search techniques for LLM token sampling can give better results (andys.page)
submitted 9 months ago by its_just_andy@alien.top to c/localllama@poweruser.forum
1 comments fedilink hide all child comments
top 1 comments
sorted by: hot top controversial new old
[–] kilust@alien.top 1 points 9 months ago

That’s really interesting! Maybe an experiment with the viterbi algorithm with the goal to maximize similarity with the context (or another score) could also improve results 🤔