this post was submitted on 23 Jun 2023
2 points (62.5% liked)

Selfhosted

39517 readers
827 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
 

I got 4 20TB drives from Amazon around Black Friday that I want to get setup for network storage. I've got 3 descent Ryzen 5000 series desktops that I was thinking about setting up so that I could build my own mini-Kubernetes cluster, but I don't know if I have enough motivation. I'm pretty OCD so small projects often turn into big projects.

I don't have an ECC motherboard though, so I want to get some input if BTRFS, ZFS, TrueNAS, or some other solution should be relatively safe without it? I guess it is a risk-factor but I haven't had any issues yet (fingers crossed). I've been out of the CNCF space for a while but Rook used to be the way to go for Ceph on Kubernetes. Has there been any new projects worth checking out or should I just do RAID and get it over with? Does Ceph offer the same level of redundancy or performance? The boards have a single M.2 slot so I could add in some SSD caching.

If I go with RAID, should I do RAID 5 or 6? I'm also a bit worried because the drives are all the same so if there is an issue it could hit multiple drives at once, but I plan to try to have an online backup somewhere and if I order more drives I'll balance it out with a different manufacturer.

you are viewing a single comment's thread
view the rest of the comments
[–] timewarp@lemmy.world 0 points 1 year ago

Thanks so much for the very detailed reply. I think at this point I'm conflicted between using TrueNAS or going all in and trying SDS. I'm leaning towards SDS primarily because I want to build experience, but heck maybe I'll end up doing both and testing it out first and see what clicks.

I've setup Gluster before for OpenStack and had a pretty good experience, but at the time the performance was substantially worse than Ceph (however it may have gotten much better). Ceph was really challenging and required a lot of planning when I used it last in a previous role, but it seems like Rook might solve most of that. I don't really care about rebuild times... I'm fine if it takes a day or two to recover the data as long as I don't lose any.

As long as I make sure to have an offsite backup/replica somewhere then I guess I can't go too wrong. Thanks for explaining the various configurations of Gluster. That will be extremely helpful if I decide to go that route, and if performance can be tuned to match Ceph then I probably will.