this post was submitted on 02 Sep 2023
260 points (99.2% liked)

Linux

48145 readers
903 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS
260
ZRAM is insane (www.kernel.org)
submitted 1 year ago* (last edited 1 year ago) by wolf@lemmy.zip to c/linux@lemmy.ml
 

I got a cheap netbook style laptop for traveling some weeks ago (HP Stream 11" with 4 GB of RAM and a N4120). Didn't expect much more from this hardware than opening a few browser tabs and doing some retro gaming via Steam.

Shared RAM with graphics card means that 3.64 GB of RAM are effectively usable for the OS. This was even too little RAM to open a handful of tabs w/o having tabs being unresponsive for seconds sometimes in a very annoying way. Another thing which made trouble was the Wifi - I guess it went into power saving, was swapped and didn't load fast enough to provide a good experience. (Of course I wasted an hour checking for Wifi drivers/support.)

In short: Even for my low expectations for this laptop it was an underwhelming experience.

First step was to look at my vm.swappiness and set it to 10, which already helped, but still the machine had hiccups and annoying timeouts.

In a last, desperate effort I enabled ZRAM on the laptop... and literally WTF: Saying it is a night and day difference doesn't do the experience justice. Typing this words now on the Stream, which I use exactly the same way as my much more beefy other machines (my next worst computer has 8G of RAM and an Intel Core i3), browsing with 10 open tabs, e-mail client open on another virtual desktop... it is crazy, it makes the Stream fun to use and I use it at home for everything which isn't heavily CPU/IO bound.

What surprised me the most: No hiccups, no timeouts and it even fixed the Wifi issues on this little machine. Didn't expect this would be possible, especially with a N4120 and 3.64 GB of RAM.

In short, my laptop changed from not even reaching my low/realistic expectations to being my favorite technical purchase of the last years, thanks to ZRAM.

Besides making this a ZRAM appreciation post, I really want to spread the word about it. Especially for old hardware and limited RAM situations, IMHO it should be the first thing which comes to mind/is recommended.

Fedora and PopOS use it by default, so it is well tested and should IMHO again, be a default at least for desktop setups.

Give it a try - supposedly it even improved the experience on much more beefy computers for gaming etc.

top 50 comments
sorted by: hot top controversial new old
[–] skullgiver@popplesburger.hilciferous.nl 52 points 1 year ago* (last edited 11 months ago) (2 children)

[This comment has been deleted by an automated system]

[–] wolf@lemmy.zip 13 points 1 year ago (1 children)

Thanks, great input.

I totally agree - ZRAM isn't magic and of course it will fall flat on its face for loads of encrypted, compressed or pure random data. In my limited day to day usage I just never hit that situation, so far.

Again, I fully agree, I wouldn't have expected that the N4120 works so well with ZRAM. For work I am forced to use a recent mac with loads of RAM. When just browsing the web/checking emails I don't feel any noticeable difference between the mac and the Stream for the CPU. (Of course, CPU/IO bound tasks are another story, and the display of the mac is in another league.) Usually I would consider myself to be quite sensitive to speed, I notice a real difference between using Gnome (with impatience etc. extensions) and Xfce, concerning the responsiveness of my desktop.

I'll check the BIOS settings, I expect the same as you. Not sure, if I will lower the reserved RAM for the iGPU, everything works fine at the moment and I want to try some light gaming on this machine.

[–] blackbrook@mander.xyz 1 points 1 year ago* (last edited 1 year ago) (1 children)

I'm not going to remember the right terminology, but you can also configure it with a chunk of disk to stick files that it can't compress into so they don't end up clogging up your swapspace.

[–] wolf@lemmy.zip 2 points 1 year ago (1 children)

Not sure if you are referring to ZSWAP, which is backed by physical swap and writes uncompressable pages to the physical swap. ZRAM has AFAIK an option called WRITEBACK, which allows it to also use physical swap, but I didn't find that ZRAM is concerned if it can compress the page or not. (Grain of salt and if someone is more knowledgeable I happily be corrected.)

[–] blackbrook@mander.xyz 2 points 1 year ago* (last edited 1 year ago) (5 children)

I'm talking about ZRAM and I did mean writeback.

"With CONFIG_ZRAM_WRITEBACK, zram can write idle/incompressible page to backing storage rather than keeping it in memory."

From https://www.kernel.org/doc/html/latest/admin-guide/blockdev/zram.html

load more comments (5 replies)
[–] severien@lemmy.world 6 points 1 year ago

Programs shouldn't get confused since RAM/swap is transparent for them.

[–] Animortis@kbin.social 29 points 1 year ago (3 children)

Anyone know of an eli5 on zram? I don't see why just compressing your RAM would make it run better.

[–] Still@programming.dev 21 points 1 year ago

stops having to swap pages to disk, slightly more overhead on the CPU side but for most systems that will be an order of magnitude faster that swapping to disk

[–] wolf@lemmy.zip 18 points 1 year ago

Let me give it a try:

Imagine you are having breakfast and sitting on your breakfast table. Everything on your table and reachable w/o getting up is what your CPU holds in its register. When you need something from the fridge in your home, this is your RAM. If you need something that is not in your fridge, you have to get dressed, get out of our home, walk to the groceries store which is half an hour away, find what you are looking for, pay for it, walk home for around half an our, switch back to your relaxed clothing and finally you can continue your breakfast. The groceries store is your hard disk/ssd whatever. With compression, imagine you have a big second fridge in the basement (or the house next to yours, you get the idea). Not as good as having stuff on your table or in your fridge, but usually at least an order of magnitude better than having to visit the groceries store.

[–] ReversalHatchery@beehaw.org 16 points 1 year ago

Turns out usually a significant amount of RAM is compressible. I was surprised at it too, and actually still am. But of course it also depends on how you use your system. If you run a media player that caches a lot to RAM, its cache wont be compressible, but they say its efficient for example for memory of web browsers.

[–] chellomere@lemmy.world 22 points 1 year ago (1 children)

I'm running ZRAM on my old Netgear ReadyNAS's, which has 512MB or 256MB RAM. It enables them to do a lot more than they otherwise would be able to, running a modern linux distribution.

I've been so satisfied with it that I even started running it on my modern desktop with 32GB RAM, it helps with my tab addiction :)

[–] wolf@lemmy.zip 13 points 1 year ago (2 children)

Rolling out ZRAM to all my boxes right now! 🙃

Do you also tweak other settings for ZRAM? According to ArchWiki PopOS settled for the following settings:

vm.swappiness = 180
vm.watermark_boost_factor = 0
vm.watermark_scale_factor = 125
vm.page-cluster = 0

I am testing this settings right now and cannot say I experience a difference compared to the defaults.

[–] Zucca@sopuli.xyz 2 points 1 year ago (2 children)

vm.swappiness value should be between 0 and 100 IIRC.

[–] Zadeis@lemmy.world 7 points 1 year ago (1 children)
[–] Zucca@sopuli.xyz 1 points 1 year ago

Yes. I stand corrected.

So the kernel memory management system wants to free up some RAM... it'll either kick stuff out of the page cache (this is the disk cache), or write some stuff out to swap. vm.swappiness determines "relative I/O cost" of swapping something out versus dropping some disk cache (i.e. how much you think it'll slow the system down.) Total value is 200, so default vm.swappiness=60 means page cache is 140 (200-60). 140/60=2.33, so it considers regular disk I/o to be about 2.33 times the speed of swap. Settings vm.swappiness=100 means swap and disk I/O are equally fast; on modern kernels, in case you had a fast swap system (like some auxillary RAM disk or optane ssds or something) you can even set vm.swappiness over 100 to say 150 to say swap is faster than your regular disk.

https://stackoverflow.com/questions/72544562/what-is-vm-swappiness-a-percentage-of

[–] wolf@lemmy.zip 1 points 1 year ago

I read several articles on this topic, and it seems there are urban legends and misunderstandings about setting vm.swappiness. The 180 was an experimental result from PopOS and Fedora people, and it only makes sense with ZRAM AFAIK. ... anyway, long story short, I ended up with the default of 60 after some testing. ;-)

[–] Thief@lemmy.myserv.one 1 points 1 year ago* (last edited 1 year ago) (1 children)

Has anyone ever actually benchmarked vm.page-cluster = 0? Makes no sense to me to suggest a cpu is so bottlenecked that disabling read-ahead would actually help. If anything it would mitigate the decompression time if it guessed correctly as the work would already be done if left at the default of 3. Normally cpu is not bound when using zram because its quite low cpu anyway.

[–] wolf@lemmy.zip 2 points 1 year ago

For my own usage, I just enabled ZRAM, 50% with zstd and left all other options unchanged, which seems to be the conservative approach and more important: It works on my machines(TM).

I would love to see some benchmarks or even a structured run down about the available options and configurations.

[–] henfredemars@infosec.pub 16 points 1 year ago (5 children)

If you like ZRAM, make sure you also enable MG-LRU and consider using ZSWAP with z3fold allocator instead because it's capable of dumping older compressed pages to swap file whereas ZRAM, once full, is simply bypassed until pages in the store are freed.

I do number crunching on memory constrained systems. MG-LRU improves the efficiency of page reclaim, and ZSWAP interacts much more nicely if you have a swap file also.

[–] wolf@lemmy.zip 8 points 1 year ago (1 children)

Thank you for your advice. Right now my setup works so I'll try to not waste my entire weekend playing with technology, but if I need further tweaks in the future I'll look into ZSWAP.

One question: Do you know why Fedora and PopOS decided for ZRAM and against ZSWAP? As I wrote already somewhere else: I did choose ZRAM for it being default in Fedora, which gave me some trust that people better informed/experienced choose ZRAM over ZSWAP.

[–] henfredemars@infosec.pub 4 points 1 year ago (1 children)

Totally understandable. I have done the wasting of weekends just to go back to where I started.

I think that ZRAM has a simpler implementation and has a history of being more widely used whereas ZSWAP is only recently seeing more usage as a default. I suspect it's in the interest of stability and because the implementation is better characterized.

With that said, MG-LRU is not enabled by default for the same reason, but it has a big impact such that it's the default on newer Android devices. Stability is a relative term.

[–] wolf@lemmy.zip 1 points 1 year ago

Thank you very much for the write up! I'll have to investigate more about ZSWAP. Have a nice weekend!

load more comments (4 replies)
[–] slampisko@czech-lemmy.eu 11 points 1 year ago (2 children)

So ZRAM is RAM, but compressed? I didn't know about it, thanks for sharing!

[–] wolf@lemmy.zip 4 points 1 year ago

Technically it is a compressed SWAP disk in RAM, but the compression ratio is impressive and it feels like more RAM for me. My pleasure to share, hope it will help you someday! :-)

load more comments (1 replies)
[–] sapient_cogbag@infosec.pub 9 points 1 year ago* (last edited 1 year ago) (2 children)

How does this compare to zswap. For me, if you still want a swap device on a real disk, this might be better? Idk >.<

Edit: arch has zswap enabled by default https://wiki.archlinux.org/title/Zswap - someone below says it is better if you have zswap when you already have a swap device :)

[–] Atemu@lemmy.ml 9 points 1 year ago (2 children)

You don't want to combine zram swap and physical swap. When zram swap is full, you'll get LRU inversion because it won't ever evict from zram swap.

Either zram-only or physical+zswap.

[–] sapient_cogbag@infosec.pub 2 points 1 year ago

Thanks ^.^

I have a very shitty notebook this is likely to be very useful for ;p

[–] Contort3860@links.hackliberty.org 1 points 1 year ago (1 children)

So, if you're using a swap partition/file you don't want zRAM, but zSwap is okay. Am I understanding that right?

[–] Atemu@lemmy.ml 1 points 1 year ago
[–] wolf@lemmy.zip 1 points 1 year ago

Sorry, just a user myself and because ZRAM is default on Fedora and was easy to setup on Debian, I am just using it.

On the Stream, I have a 4G physical swap partition as a backup, though. AFAIK the physical partition will be utilized by ZRAM when needed. (ZRAM simply has higher priority swap).

[–] selokichtli@lemmy.ml 7 points 1 year ago

Some years ago I needed to use more than 100 GB of RAM in a 32GB RAM computer, repeatedly. zRAM and swapping in a SSD made the whole thing bearable. In the pandemic, RAM was expensive and I was broke.

[–] Rescuer6394@feddit.nl 6 points 1 year ago* (last edited 1 year ago) (4 children)

Isn't zswap enabled by default?

having zram + swap on disk isn't the same as having zswap + swap on disk? the difference should be only that zram show as a swap device while zswap does not.

having only zram, you are still confined by the total ram you have. idk how the average compression ratio is, but you can gain 1.5x ram max. to get more, you need a physical swap device.

is there an advantage of using zram instead of zwap? when you still have a physical swap with lower priority.

bonus question: What if I use all 3 of them? would this just be redundant?

[–] TheWoozy@lemmy.dbzer0.com 2 points 1 year ago

I used zram + swap for years. I dedicated 25% of my memory to zram. The problem is that zram would get filled with infrequently used data, and disk swap would get the frequently used data. Once that happens everything slows down.

Zswap tries to fix that be creating a compressed swap buffer in memory. Older/less used data will get written to disk, but fresh/frequently used data will stay in the compressed ram buffer. That's my understanding, at least. I don't remember how to query Zswap usage stats.

[–] wolf@lemmy.zip 1 points 1 year ago (1 children)

I am using Debian 12 and I am pretty sure zswap is not enabled by default.

With zstd the compression ratio is better than 3 in all experiments I saw. (Of course you won't get this numbers for random/encrypted data). Right now I have 12MB compressed to 2MB via ZRAM (fresh reboot) which is a factor of 6.

So, taking 3 as factor learned from others and my experience, with 1.8 GB of ZRAM I can store 5.4 GB of memory, adding the 1.8 GB of usual RAM, I end up with 7.2 GB of RAM which is double my 3.6 GB RAM I started with. (All this is backed by 4 GB of physical SWAP.)

Sorry, I cannot really answer your questions concerning zswap vs ZRAM, I just follow the herd and trust that the Fedora people usually have good reasons for their technical choices and are deploying ZRAM by default for several years now.

[–] neo@hexbear.net 1 points 1 year ago (1 children)

zstd

Just btw, while zstd's compression ratio might be stronger, it will not be as fast as something like lzo-rle. When it comes to RAM you will definitely want to prefer speed unless you have a strict space usage requirement.

load more comments (1 replies)
load more comments (2 replies)
[–] floppy@rabbitea.rs 6 points 1 year ago

I use this on all my Pis.

[–] ohmesocorny@discuss.online 3 points 1 year ago (1 children)

Thanks wolf@lemmy.zip !

Thanks to your post and plenty of config tutorials, I've got this set up on my Oracle Free Tier VPS running Ubuntu. It has recently been struggling hard with 1GB ram, requiring reboot. The difference with zram enabled... WOW.

I haven't been able to get zram working on my Ubuntu VPS with another provider though - search results suggest that some providers don't allow swap.

load more comments (1 replies)
[–] hjpoijnerflkjn@feddit.de 3 points 1 year ago

Having had massive problems using normal swap in combination with zfs in out of memory situations with high memory pressure I now only - but as default - use zram on bare-metal machines.

[–] eliasp@feddit.de 1 points 1 year ago

zram did wonders back then to the performance/usability of Palm/HP webOS devices, especially the 1st Pre.

load more comments
view more: next ›