this post was submitted on 17 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
What UI do you use and why? (alien.top)
submitted 1 year ago by Deadlibor@alien.top to c/localllama@poweruser.forum
57 comments fedilink hide all child comments
 

From the wiki:

Text generation web UI

llama.cpp

KoboldCpp

vLLM

MLC LLM

Text Generation Inference

you are viewing a single comment's thread
view the rest of the comments
[–] Demortus@alien.top 1 points 1 year ago

Text generation web UI. The install script has worked perfectly every time I've run it, and the miniconda environment it creates is useful both within the web interface and for running LLM in python scripts. The interface also makes installing and using new models a breeze.