RemindMe! 2 weeks
this post was submitted on 09 Nov 2023
1 points (100.0% liked)
LocalLLaMA
3 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 1 year ago
MODERATORS
For what? I'm partial to silly tavern and the textgen notebook modes to do freeform. Why care if it works with openAI? That's literally the opposite of "self hosted for privacy".
Oobabooga can work with OpenAI, can be self-hosted and store system prompts and dialogs
it can work with openai? i thought it was only for local models
I am releasing a UI that meets those requirements in the next few days, was originally going to have the code ready the 31st of last month but has some stuff come up. Here is a link to the original post I made on it a few weeks back, it supports what you are looking for and has other cool features like plugins (chat function calling) and model routing.
Could you use a Spell Book this Halloween? : LocalLLaMA (reddit.com)
I'm collecting UIs for local models and UIs powered by OAI API (the second one is outdated, by ~4 months). Everyone's "best" varies, but overall, I haven't noticed much progress.
I would also add multi modal features to the requirements.
Huggingface chat-ui is nice and can be self-hosted as well: https://github.com/huggingface/chat-ui
Not sure it’s any better than what you’re already using, but it’s worth checking out.
-
LoLLMS, seen getting updates, V7 appeard recently, I like it but it's more "for fun" than for doing some work I need to do. It's super easy, and has lot of plugins, like you just choose personality artist, and for SD it just forks the A1111 and provide image. Also it should recognize images and read docs. Best impresion on me so far.
-
LMstudio
-oobabooga
I'm making a web ui for Open AI, oobabooga, koboldcpp.
https://github.com/Julian-adv/IlluStory
It's for Windows now (tauri exe).