this post was submitted on 26 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

So far, I have experimented with the following projects:

https://github.com/huggingface/chat-ui - Amazing clean UI with very good web search, my go to currently.

https://github.com/oobabooga/text-generation-webui - Best overall, supports any model format and has many extensions

https://github.com/ParisNeo/lollms-webui/ - Has PDF, stable diffusion and web search integration

https://github.com/h2oai/h2ogpt - Has PDF, Web search, best for files ingestion (supports many file formats)

https://github.com/SillyTavern/SillyTavern - Best for custom characters and roleplay

https://github.com/NimbleBoxAI/ChainFury - Has great UI and web search (experimental)

https://github.com/nomic-ai/gpt4all - Basic UI that replicated ChatGPT

https://github.com/imartinez/privateGPT - Basic UI that replicated ChatGPT with PDF integration

LM Studio - Clean UI, focuses on GGUF format

-

Really love them and wondering if there are any other great projects,

Some of them include full web search and PDF integrations, some are more about characters, or for example oobabooga is the best at trying every single model format there is as it supports anything.

What is your favorite project to interact with your large language models ?

Share your findings and il add them!

you are viewing a single comment's thread
view the rest of the comments
[–] RYSKZ@alien.top 1 points 11 months ago

Right now, I'm using your earlier project [1]. It's proving to be incredibly helpful, thank you!.

Since it's a desktop application, it's more convenient for me than the WebUIs, because I tend to have a lot of tabs open in my browser, which makes it pretty chaotic. I have set up an AutoHotkey script to can easily launch it using a easy to remember hotkey.

[1] https://github.com/shinomakoi/magi_llm_gui