this post was submitted on 17 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
What UI do you use and why? (alien.top)
submitted 1 year ago by Deadlibor@alien.top to c/localllama@poweruser.forum
57 comments fedilink hide all child comments
 

From the wiki:

Text generation web UI

llama.cpp

KoboldCpp

vLLM

MLC LLM

Text Generation Inference

you are viewing a single comment's thread
view the rest of the comments
[–] Maykey@alien.top 1 points 1 year ago

My own because if I didn't want to have control I would use ChatGPT and which I tried lack features I want: parameter randomization mid inference; generating several responses in sequence(not at once as kobold); having good editing experience(no undo tree = not for me); manual limiting of what tokens are being sent to the models(I don't want silent trimming when I have to guess the actual context)