What are the storage implications of setting up your own instance? Are you syncing the contents of every sub or just the ones you and your friends subscribe to? I like the idea of doing it but will it be TB’s of content in a few months?
this post was submitted on 16 Jul 2023
204 points (97.2% liked)
Selfhosted
39964 readers
265 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 1 year ago
MODERATORS
Just the ones people subscribe to.
I have an instance with over 600 users that has been up 6 weeks, and the storage grows every day. Database is 22GB and image cache + uploads is 30GB. In theory the cache should be cleared after a certain time, but I'm not aware of a configuration setting for this in Lemmy.
For the database a fix is incoming for the next release that will decrease the size a lot. For image storage it is more complicated, but configuring Pict-rs to only accept images of a certain size and convert them to webp does help a bit.
You nailed it, it only pulls posts from communities that someone on your instance subbed to. It doesn't even pull retroactively; your instance only starts pulling posts created after the first subscriber on the instance subbed.
I'm more concerned regarding media, because just like Mastodon, the pics themselves are copied from other instances onto yours. I hope it will be enough to just find -mtime -delete once in a while
Unfortunately, you will soon realize that due to bad design by the Lemmy developers, that the pictures pulled are actually on the smaller side, and a particular activity table in your database will be a ever-growing tumor on your disk space.
Some people say manually purging the activity table for entries older than a week or so should be safe enough.
What's that?
load more comments
(1 replies)
Also seeing the federation happening live at tail -f /var/log/nginx/access.log is so satisfying. I think I like computers
It’s also interesting to see how many random webcrawlers are out there! When I was first setting up my instance I was spot checking some IPs and found all sorts of interesting security services.
I think I have the tech know-how to do it, but what worries me is that users could post illegal content, which my instance could then pull in. Since it’s on my storage, I would be legally responsible for that. So I’d have to constantly check, probably. How do others do this?
Unfortunately, depending on jurisdiction, remediation may range from just having a take down notice form, to having the cops at your door, it's definitely something to weigh out before starting your own instance.
Thats what worries me as well. I‘m an aspiring self hoster. Got many services but still learning. Having to deal with authorities is not something I look forward to.
load more comments
(5 replies)
I've just gotten my own instance of Lemmy running here and think I'm getting the hang of how to subscribe and link up to other instances. This is also a teaser to see if my first comment actually works!
I wish someday self-hosting anything (not just Lemmy) becomes as easy as installing an app. Self-hosting doesn't need to be a nerd thing.
The hard part is the network. Everything is different with different ISP. The DNS is another challenge, you need to buy your 'internet real estate' and have it work correctly if your IP change.
Security is another challenge but I think it's easier to notice unusual traffic from your basement server than from a mega-tech-bro-corporation. There's probably some easy software that could do that.
Unraid with some Community Apps and Docker turned on is pretty turn-key with a ton of room for superusers.
@mfat
https://yunohost.org/ is an attempt to fill that gap, but it's missing a key feature. Anything that wants to be broadly adopted will have to be appified these days.
@maor
It is cool, but lately there has been a bit too much hassle with it - my instance (latest versions mind you) is federating like shit.
There are often posts with wildly different upvote and comment counters, comments not loading at all even after days and so on.
I tried looking into it, both in issues on GH and Matrix room but no-one has time:/
https://github.com/lflare/lemmy-subscriber-bot
Your instance only has 45 communities. Those are rookie numbers. You got to pump them up :D
load more comments
(1 replies)
It was a fun experience trying to get to all work. I did originally try on my raspberrypi but I ended up just giving up on that due to the issues you mentioned. But it's nice to have my own instance, and slowly populating the all feed with new subscriptions and well I owned the domain va11halla.bar I had to use it for my name.
"vanity purposes" lmao I love it
Well...
I have no idea what you are talking about /s
I'm enjoying worrying people with my vanity domain. My instance is essentially single user (me and a couple selected friends)
It's certainly been an adventure for me that's mostly spurred me to learn about how to user/admin docker. (I need a project to dig into to learn things.)
I'm running my own server on a linode. I've got it on the cheapest tier which is $5 a month. I'm not quite sure what I'm going to do when the 25GB gets full, I'll have to find out the best way to delete old posts and pictures.
load more comments
(1 replies)
How useful it is to actually have a self-hosted lemmy instance if u are alone on it btw ?
Very useful. I can federate with instances that don't federate with each other. I can federate with both lemmy.ml and lemmygrad.ml, even if I don't necessarily have to agree with either of their views.
Usefull as in fun? Or the fact you're the boss? Top dog?
Hey there! Welcome to the joy of running your own instance, I built a tool to automatically discover and add communities to your local instance :)
https://github.com/lflare/lemmy-subscriber-bot
For support requests, I’ve created !lsbsupport@lemmy.world as well.
Hi there! Looks like you linked to a Lemmy community using a URL instead of its name, which doesn't work well for people on different instances. Try fixing it like this: !lsbsupport@lemmy.world
Frankly I'm not sure what it does haha. What are the "best communities"? Which communities? Also what does it actually do, subscribes all users on your instance to those "best communities"?
It's actually a tool I wrote that makes use of a bot account on your own instance to add and/or subscribe to communities throughout the fediverse. I defined "best" communities as simply communities above a certain level of activity threshold (omitting ghost/unpopular communities). It doesn't subscribe all users on your instance to the communities, but it does make such that your All feed would be vastly more populated with content.
load more comments
(1 replies)
load more comments
(1 replies)
The more I see this community the more I think about starting a mastodon/Lemmy instance of my own. I used to have a home rack setup, but a 1U in an apartment isn’t ideal. I’ve cut down to just a old desktop with a pair of redundant 8TB drives now and might have to spin up a cheap vps somewhere.
You can go a looong way hosting stuff on ultra-small form factor business PCs
Is there a community for troubleshooting self-hosted lemmy instances? Mine has issues showing search results and adding other instances. Unfortunately there's not a lot I can find with my Google-fu.
I would love to do this but I'm afraid of exposing my home IP to the world of spammer and what not. Did you selfhost on a cloud provider or did you do it from your home ? How crazy does the security need to be around Lemmy instance ? I really feel like it's a beacon of come hack me if you can!
One method that many people use to hide their IP address of their host is to use Cloudflare for DNS, that way you don't directly expose your IP address to the wider internet. A nice bonus to Clouldflare is that it's free too! Just get yourself a domain, get Cloudflare set up to provide DNS for it and you're golden.
Cloudflare tunnels! I use it to expose my nextcloud server to the internet. Works flawlessly.
load more comments
(1 replies)
I just rented a VPS from Hetzner because that's the workflow I'm already familiar with. Lowest tier, 5$, and since it's ARM it's also beefy enough to never need an upgrade I hope :P
load more comments
(1 replies)
We really need a CPanel/Softaculous installer like we have for wordpress etc. Would love to host, but atm there's so much backend config for JoeDev to deal with.
I’ve been trying to get lemmy broken up to microservices for my Raspberry Pi k3s cluster. I have postgres running but I’m well outside my comfort zone trying to learn how kubernetes works. If I stand up the other microservices (pictrs and lemmy) do I just need to use the same namespace? How do I tell it the server url/fqdn/ip for postgres? Does metallb do that for me?
It took me so much fucking time to realize how it works. There it is:
https://kubernetes.io/docs/concepts/services-networking/dns-pod-service/
I learned Kubernetes in a hurry in my previous job, so I skimmed over lots of "obvious" things (in my manager's eye) and this was one of them:(
view more: next ›