this post was submitted on 24 Jun 2026
139 points (81.2% liked)

Selfhosted

60409 readers
1067 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
 

Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

you are viewing a single comment's thread
view the rest of the comments
[–] Lettuceeatlettuce@lemmy.ml 5 points 1 week ago (1 children)

What local models have you been using? And what hardware are you running them on? I've been playing with local LLMs a bit for exactly your use case.

I have zero interest in vibe coding or full agentic workflows. But having a local LLM generate a Bash script to help me automate parts of my home lab infrastructure would be nice.

[–] Die4Ever@retrolemmy.com 1 points 1 week ago (1 children)

What are your hardware specs?

[–] Lettuceeatlettuce@lemmy.ml 2 points 1 week ago (1 children)

Ryzen 7 5800 X3D Radeon RX 9070XT 32GB of DDR4 system memory.

[–] OhVenus_Baby@lemmy.ml 2 points 1 week ago

How hard does it push this setup? How far can you scale up your own models on this hardware?