this post was submitted on 31 Jul 2023
255 points (96.7% liked)

Lemmy.World Announcements

29161 readers
50 users here now

This Community is intended for posts about the Lemmy.world server by the admins.

Follow us for server news 🐘

Outages πŸ”₯

https://status.lemmy.world/

For support with issues at Lemmy.world, go to the Lemmy.world Support community.

Support e-mail

Any support requests are best sent to info@lemmy.world e-mail.

Report contact

Donations πŸ’—

If you would like to make a donation to support the cost of running this platform, please do so at the following donation URLs.

If you can, please use / switch to Ko-Fi, it has the lowest fees for us

Ko-Fi (Donate)

Bunq (Donate)

Open Collective backers and sponsors

Patreon

Join the team

founded 2 years ago
MODERATORS
 

Lemmy.world has been down between 02:00 UTC and 05:45 UTC. This was caused by the database spiking to 100% cpu (all 32 cores/64 threads!) due to inefficient queries been fired to the db very often.

I’ve collected the logs and we’ll be checking how to prevent this. (And what caused this)

top 37 comments
sorted by: hot top controversial new old
[–] zikk_transport2@lemmy.world 92 points 1 year ago (3 children)

lemmy.world is a test environment for Lemmy developers.. πŸ˜… Jokes aside, issue is an issue.

[–] slimerancher@lemmy.world 38 points 1 year ago

Well, as pretty much the biggest instance, it provides the best data for load-testing. 🫣

[–] ReadyUser31@lemmy.world 33 points 1 year ago

All Lemmy instances are test environments right now. It's just that lemmy.world is being tested the hardest.

[–] Blaze@sopuli.xyz 18 points 1 year ago (1 children)

It's a good reminder that other large instances (lemm.ee, sh.itjust.works, reddthat.com, sopuli.xyz) usually offer higher uptime while showing the same content as LW

[–] ReadyUser31@lemmy.world 10 points 1 year ago (1 children)

My issue with the smaller instances is that I enjoy browsing Local, and this is typically not as active or interesting on there. Is there a way to browse lemmy.world's Local from another instance?

[–] Blaze@sopuli.xyz 0 points 1 year ago (2 children)

Local makes sense for a country or field focused instance (queer rights, programming, even porn or whatever), not so much for generalist instances, unfortunately.

The way you use local only makes sense now as most of the communities are on LW. Once a few of them start to branch out (such as lemdro.id or startrek.website), if you want to see that content, you will either subscribe or use all

[–] BURN@lemmy.world 4 points 1 year ago

Honestly I really don’t like that model. I only subscribe to communities I am active in and all is just porn spam. Local is 100% the best way to browse right now.

[–] luis123456@mastodon.social 2 points 1 year ago

@Blaze @ReadyUser31 I love using all to find new stuff

[–] flubba86@lemmy.world 59 points 1 year ago (2 children)

Every Lemmy update:

"We fixed some performance issues by optimising some queries."

Also: "To balance it out, we added some new even more inefficient queries."

[–] kratoz29@lemmy.world 34 points 1 year ago (1 children)
[–] ElBarto@lzrprt.sbs 7 points 1 year ago (1 children)

How else are they supposed to patch things out? can't leave it up to fate, gotta make your own destiny!

[–] kratoz29@lemmy.world 2 points 1 year ago

Huh, isn't this instance only?

I just think tried from Connect for Lemmy in this comment and I couldn't.

[–] Blaze@sopuli.xyz 22 points 1 year ago

Thank you for the update!

[–] ttmrichter@lemmy.world 18 points 1 year ago (2 children)

(And what caused this)

Prediction: bad database programming. ;)

[–] NewNewAccount@lemmy.world 14 points 1 year ago (1 children)

Are we extracting enough value out of our volunteer developers and DBAs?!

[–] ewe@lemmy.world 3 points 1 year ago

The beatings will continue until morale improves!

Or clever denial of service attacks

[–] Possible_EmuWrangler@lemmy.world 16 points 1 year ago* (last edited 1 year ago)

Thanks for keeping us updated. FYI i noticed an issue there was an error message saying to check (the matix) and (somewhere else, Lemmy community support?). Both of them pointed to the same URL, but im sure they were meant to point to different places.

Edit. Happed again and I took notes. Both point to lemmy.ml community support

[–] AlmightySnoo@lemmy.world 7 points 1 year ago (1 children)

It seems to start at roughly the same hour every day, at around 01:20 UTC

[–] ruud@lemmy.world 11 points 1 year ago

Yup. We might be on to something now

[–] md5crypto@lemmy.world 0 points 1 year ago

Another DDOS attack?