Just started self hosting this instance. Nothing on the docs mentioned anything about storage considerations.
This is lemmy.world after 4 weeks:
58G pictrs 34G postgresConsidering this is going to be around a 5 user instance at most I think I’ll be good for awhile. Thanks!
im running 50 users right now, subbed to A LOT of communities, seeing db growth of about 100mb per day.
That seems high when you extrapolate that to 10000 users, like a larger instance might have.
It’s all about how many communities your user(s) subscribe to since your instance basically acts as a mirror for those.
My instance has been running for 23 days, and I am pretty much the only active local user:
7.3G pictrs 5.3G postgresedit: I may have a slight
RedditLemmy problemSo if you’re the only user (let’s assume for ease) then, that represents all the updates (posts, comments, votes) from each community that you are subscribed to?
Yeah, and I purposely subscribe to (or sometimes have a dedicated “federation helper bot” account I run subscribe to) most of the most popular communities on the most popular instances so I can get a decent sampling of what’s going on in the fediverse on the “All” feed. So I assume my storage usage is maybe a bit higher than what an “average” single-user instance may be…
Question if you know: does a lemmy instance have to be publically accessable to work? Like, if I make an instance on my homelab can the instance “fetch” content and serve it faster locally? Could I reply to a post and have others see it? Etc
Now I wonder how viable it would be to support video hosting. The answer is almost certainly “God no!”
It is viable through other hostings
Wow, that is surprisingly not bad given the size of the instance!
Feels like this will benefit from some sort of fuzzy deduplication in the pictrs storage. I bet there are a lot of similar pics in there. E.g. if one pic or a gif is very similar to another, say just different quality or size, or compression, it should keep only one copy. It might already do this for the same files uploaded by different people as those can be compared trivially via hashing, but I doubt it does similarity based deduplication.
This is my small instance with way fewer users than lemmy.world.
11G pictrs 5.2G postgresOut of curiosity, how long has your instance been up? Just want to get a sense of how fast storage is increasing for you.
23 days.
How has your Lemmy experience been on a self hosted instance? I’m currently using lemmy.world and it’s very error prone, would self hosting reduce those errors at the expense of anything? Does federation take long or do you find you’re getting federated content quickly enough?
The experience has been pretty good, to be honest. No instability, easy updates, etc. I find federated content quite quickly, because I use this script to populate the “All” feed.
Thanks for the script!
I didn’t make it! :) I think, @fmstrat@nowsci.com made it.
My instance has 13 users, and has been up for 2 months now:
1.5G ./pictrs 3.4G ./postgres476M ./postgres 1.1G ./pictrs
After 3 weeks
Depends. If you have a lot of users posting a lot of pictures and you use pictrs out of the box config, then a lot. If you are just running a few users with finite communities being synced then a lot less. The number is going to vary a lot as lemmy grows and gets older so hard to document realistic expectations. But docker images are probably going to take up more disk space than actual contents unless you get quite big. I just threw my PG volume into a tgz to move servers and it’s less than a gig.
My instance dormi.zone has been running for around 3½ weeks now, has a 3-digit amount of users and hosts a community with little more than 1000 subscribers. Here’s how much storage it currently takes up:
- 4.9 GiB pictrs
- 6.2 GiB postgres
In the default Ansible configuration, storage will mostly be accumulated by log files that are automatically generated by Docker and deleted whenever you restart the Docker containers.
Is there any way to purge old data?
I really hope it doesn’t get purged if lemmy is to be a Reddit replacement. A lot of the value Reddit had was obscure knowledge and making google searches actually usable.
Are you planning on donating to instances that don’t purge old data?
It depends on how many communities you end up pulling in. Your instance will only sync with communities that a user on your instance is subscribed to.
I’ve had my instance running for about 1 week and I’m the only user.
2.1G pictrs
2.5G postgres
