this post was submitted on 17 Nov 2023
1 points (100.0% liked)

LocalLLaMA

4 readers
4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago
MODERATORS
communick@poweruser.forum
1
What UI do you use and why? (alien.top)
submitted 2 years ago by Deadlibor@alien.top to c/localllama@poweruser.forum
57 comments fedilink hide all child comments
 

From the wiki:

Text generation web UI

llama.cpp

KoboldCpp

vLLM

MLC LLM

Text Generation Inference

you are viewing a single comment's thread
view the rest of the comments
[โ€“] mcmoose1900@alien.top 1 points 2 years ago (5 children)

Don't forget exui: https://github.com/turboderp/exui

Once it implements notebook mode, I am probably going to switch to that, as all my reasons for staying on text gen ui (the better samplers, notebook mode) will be pretty much gone, and (as said below) text gen ui has some performance overhead.

[โ€“] ReturningTarzan@alien.top 1 points 2 years ago

Notepad mode is up fwiw. It probably needs more features, but it's functional.

load more comments (4 replies)