Selfhosted

60253 readers

1350 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

141

What's up, selfhosters? It's selfhosting Sunday again! (lemmy.nocturnal.garden)

submitted 1 year ago by tofu@lemmy.nocturnal.garden to c/selfhosted@lemmy.world

113 comments fedilink hide all child comments

What’s up, what’s down and what are you not sure about?

Let us know what you set up lately, what kind of problems you currently think about or are running into, what new device you added to your homelab or what interesting service or article you found.

I finally finished my first iteration of my Minilab including a very smooth migration from the old server yesterday so I can go to the service side of things again. I plan to get some kind of selfhosters VPN for external access to stuff that's not exposed to the internet, I'll have to investigate which one.

you are viewing a single comment's thread
view the rest of the comments

[–] chirospasm@lemmy.ml 11 points 1 year ago* (last edited 1 year ago) (1 children)

Hello! I recently deployed GPUStack, a self-hosted GPU resource manager.

It helps you deploy AI models across clusters of GPUs, regardless of network or device. Got a Mac? It can toss a model on there and route it into an interface. Got a VM on a sever somewhere? Same. How about your home PC, with that beefy gaming GPU? No prob. GPUStack is great at scaling what you have on hand, without having to deploy a bunch of independent instances of ollama, llama.ccp, etc.

I use it to route pre-run LLMs into Open WebUI, another self-hosted interface for AI interactions, via the OpenAI API that both GPUStack and Open WebUI support!

[–] RagingHungryPanda@lemm.ee 2 points 1 year ago

Oh that's dope. How many hours are you running? Do you also use them for things like encoding or something like that?