this post was submitted on 24 Jun 2026
139 points (81.2% liked)

Selfhosted

60366 readers
1004 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
 

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

you are viewing a single comment's thread
view the rest of the comments
[–] de_lancre@lemmy.world 1 points 1 week ago

Same, toyed with it for creating stupid things like bot for telegram, that basically was a 3rd-person NSFW storyteller in RP chat. Sadly, after I made said bot I remember that I don't have friends to RP with.

That being said, ollama+openwebui kinda sucks: openwebui have "wider scope" and features that you don't need like auth via social providers and managing multiple accounts, while ollama itself does the opposite and lacks certain features (like proper mmap support to load big models), slow in comparison to pure llama.cpp and generally easily replaceable with lm studio, that provides both - client and server. So yeah, my advise for anyone who want to try it localy - just use lm manager.