this post was submitted on 12 Sep 2023
110 points (98.2% liked)
Linux
47270 readers
2152 users here now
From Wikipedia, the free encyclopedia
Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).
Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.
Rules
- Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
- No misinformation
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
Community icon by Alpár-Etele Méder, licensed under CC BY 3.0
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
a striped hot ssd cache for a massive raided backend on a VM host - all done with native filesystem support sounds pretty good to me.
You're running local storage for a VM host? Or are you talking more like whiteboxing your own NAS?
I understand what bcachefs does. I've used bcache many years ago to do exactly what you're describing, albeit for bare metal servers. I'm asking why.
I'm just trying to understand what the use case would be in 2023 outside of a home lab, given that cost per gigabyte is basically at parity between SSDs and HDDs when you consider TCO (i.e. when you price in the extra power and cooling overhead for the HDDs, failure rates, and such).
I have a pretty strong usecase for distributed Small/Medium Business bare metal VM hosts. most locations do not need NAS/SAN, and DAS will more than suffice. lower cost hardware with a near-line raided backend and SSD hotcache at FS level seems to be a pretty decent sweet spot.
obviously this is not some enterprise grade setup and YMMV, but I am pretty interested in a all-in-one FS solution. I am sure others may have more innovative setups where its even more interesting.
Sounds like a great use case.
I'm assuming your nearline drives speak SAS? Are you doing redundant controllers on the backplane for multipathing and for fault tolerance? I'm not sure if bcachefs specifically supports it (or if that would happen at a different layer) but distros in general should support it.
TCO gets split into CAPEX and OPEX, so you come out ahead on the initial purchase even though it uses more power in the long run, which surely looks better to the business.