Selfhosting storage is pretty good to, if you're into that.
Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
I'd like to avoid that as I don't consider my home network reliable enough for such a critical task.
Understandable. Sadly, really reliable storage is pretty pricey.
And here I am running NFS as the backing storage on an R720xd for 4 other M630 VM hosts.
Connected via SFP+ DAC. I get max bandwidth saturation, and ~65k IOPS!! NFS is great 😅
You could use things like AWS S3 or similar offerings from other providers like digitalocean. They have plenty of documentation that guide you through how they work.
Google and dropbox are ~10€ a month for 2 TB. Idk is that solution for you, but I would consider building NAS at home. I mean...this is selfhosted channel :)
For backup I use backblaze, but thats cheap only if you dont download a lot, also not sure can it be used for your case. Sry, not rly helpful (:
I'm never going with Google/Dropbox ^^ the goal is to be in control of my data. Backblaze could be an option, but I expect too many read/writee for it to be cheap.
I considered the NAS at home but my home net is not reliable enough.
TBH I'm still looking for a better option to share storage between servers other than NFS. There has to be something better in 2023!
NFS kinda sucks and I'm looking for alternative solution
Rsync + cron? If you just need to backup some files/directories.
Edit: ah, saw that you will read/write a lot. Do you really need to do that over the network? Why not upload a .tar, a snapshot or whatever of the changes?
If you could be a bit more specific then maybe we could give some better advice.
Use a seedbox if you're downloading stuff and dont have enough disk space.
The best example would be a running an email or chat server. The spool/media directories can go large pretty quick as users share pictures, gifs, ... So I would like to mount it from a remote location because the matrix server itself only has a 20G SSD for the whole OS. Rsync won't cut it there as I have a specific process writing to a location.
Ah, I see.
Perhaps sshfs could be an alternative. Not sure of the performance out of the box, but it is possible to tweak a bit.
Hetzner has their storage boxes which are very cheap, might be an option.
Alternatively use an external S3 provider like Wasabi or Backblaze.
I use Digital Ocean Spaces (S3 Bucket) costs $5 / 250 GB / month
How do you use them ? Do you mount the bucket locally on the server ?