Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
-
No low-effort posts. This is subjective and will largely be determined by the community member reports.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
view the rest of the comments
I think its better if their github mention the minimum token count requirement to selfhost this. I don't think it will ever reach something usable for normal selfhost user.
Based on your statement i think most of your experience come from corporate AI usage... Which deploy multiple agent system in their AI and hosted in large data center.
I do selfhost my own, and even tried my hand at building something like this myself. It runs pretty well, I'm able to have it integrate with HomeAssistant and kubectl. It can be done with consumer GPUs, I have a 4000 and it runs fine. You don't get as much context, but it's about minimizing what the LLM needs to know while calling agents. You have one LLM context that's running a todo list, you start a new one that is charge of step 1, which spins off more contexts for each subtask, etc. It's not that each agent needs it's own GPU, it's that each agent needs it's own context.