noco-ai

joined 10 months ago
[–] noco-ai@alien.top 1 points 9 months ago

OpenAI is also so overwhelmed with demand that their API "limits" are a complete joke. I have a tier 4 account and have always hit server error issues when running any kind of single threaded application with their API well before hitting any of their published limits. I get more TPS from my local systems than I was ever able to get from the OpenAI API.

[–] noco-ai@alien.top 1 points 9 months ago

I released a UI last week noco-ai/spellbook-docker (github.com). Has chat plugins with 50+ in v0.1.0 that handle things like simple math (multiplication, addition, ...), image generation, TTS, Bing news search, etc.

[–] noco-ai@alien.top 1 points 10 months ago

Might be overkill for your use case but the UI I created stores conversations in MariaDB, it is not multi user so anyone who accesses the UI will see the same conversations.

https://github.com/noco-ai/spellbook-docker

[–] noco-ai@alien.top 1 points 10 months ago

I am releasing a UI that meets those requirements in the next few days, was originally going to have the code ready the 31st of last month but has some stuff come up. Here is a link to the original post I made on it a few weeks back, it supports what you are looking for and has other cool features like plugins (chat function calling) and model routing.

Could you use a Spell Book this Halloween? : LocalLLaMA (reddit.com)