this post was submitted on 24 Jun 2026
139 points (81.2% liked)
Selfhosted
60366 readers
976 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil.
-
No spam.
-
Posts are to be related to self-hosting.
-
Don't duplicate the full text of your blog or readme if you're providing a link.
-
Submission headline should match the article title.
-
No trolling.
-
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Yes. Openwebui/ollama for LLM, comfyui for stable diffusion. I just dick around with it as a toy.
Same. Its somewhat useful on some very small scripting or tasks...but its mostly just to try out a new model or two. Its not really useful for anything big.
I will have to say....even my tiny models are about as good as Chatgpt/Claude/etc... which makes me think about how much people are spending on tokens regularly. I was able to get the same kind of python script started with my local tiny model that was comparable to the newest Claude code offerings.
What local models have you been using? And what hardware are you running them on? I've been playing with local LLMs a bit for exactly your use case.
I have zero interest in vibe coding or full agentic workflows. But having a local LLM generate a Bash script to help me automate parts of my home lab infrastructure would be nice.
What are your hardware specs?
Ryzen 7 5800 X3D Radeon RX 9070XT 32GB of DDR4 system memory.
How hard does it push this setup? How far can you scale up your own models on this hardware?
I was put off by ComfyUI, seems awfully complex. How is your experience?
Any suggestions to start? I have Fooocus installed now
It is difficult to understand in the beginning but has great support for premade workflows. It even saves the workflow into its output images so you can drag and drop them into the webui to duplicate the setup that generated the image. Use the internet to get premade workflows and mess around with them to see what the options do and you'll slowly learn how it works. If you don't care about precise control over the generations or understanding how image generators works then just use something else more all-in-one.
Same, toyed with it for creating stupid things like bot for telegram, that basically was a 3rd-person NSFW storyteller in RP chat. Sadly, after I made said bot I remember that I don't have friends to RP with.
That being said, ollama+openwebui kinda sucks: openwebui have "wider scope" and features that you don't need like auth via social providers and managing multiple accounts, while ollama itself does the opposite and lacks certain features (like proper mmap support to load big models), slow in comparison to pure llama.cpp and generally easily replaceable with lm studio, that provides both - client and server. So yeah, my advise for anyone who want to try it localy - just use lm manager.