this post was submitted on 17 Nov 2023

1 points (100.0% liked)

LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

1

What UI do you use and why? (alien.top)

submitted 10 months ago by Deadlibor@alien.top to c/localllama@poweruser.forum

57 comments fedilink hide all child comments

From the wiki:

Text generation web UI

Text Generation Inference

you are viewing a single comment's thread
view the rest of the comments

[–] SatoshiNotMe@alien.top 1 points 10 months ago

A bit related. I think all the tools mentioned here are for using an existing UI.

But what if you wanted to easily roll your own, preferably in Python. I know of some options:

Gradio https://www.gradio.app/guides/creating-a-custom-chatbot-with-blocks

Panel https://www.anaconda.com/blog/how-to-build-your-own-panel-ai-chatbots

Reflex (formerly Pynecone) https://github.com/reflex-dev/reflex-chat https://news.ycombinator.com/item?id=35136827

Solara https://news.ycombinator.com/item?id=38196008 https://github.com/widgetti/wanderlust

I like streamlit (simple but not very versatile) And reflex seems to have a richer set of features.

My questions - Which of these do people like to use the most? Or are the tools mentioned by OP also good for rolling your own UI on top of your own software ?