this post was submitted on 05 Jun 2023
162 points (99.4% liked)

Lemmy

12459 readers
2 users here now

Everything about Lemmy; bugs, gripes, praises, and advocacy.

For discussion about the lemmy.ml instance, go to !meta@lemmy.ml.

founded 4 years ago
MODERATORS
 

With forewarning about a huge influx of users, you know Lemmy.ml will go down. Even if people go to https://join-lemmy.org/instances and disperse among the great instances there, the servers will go down.

Ruqqus had this issue too. Every time there was a mass exodus from Reddit, Ruqqus would go down, and hardly reap the rewards.

Even if it's not sustainable, just for one month, I'd like to see Lemmy.ml drastically boost their server power. If we can raise money as a community, what kind of server could we get for 100$? 500$? 1,000$?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] OsrsNeedsF2P@lemmy.ml 35 points 1 year ago (3 children)
8 vCore
32 GB RAM

๐Ÿ˜ฌ

2 follow-ups:

  • Can we replace Lemmy.ml with Join-lemmy.org when Lemmy.ml is overloaded/down?
  • Does LemmyNet have any plans on being Kubernetes (or similar horizontal scaling techniques) compatible?
[โ€“] poVoq@slrpnk.net 19 points 1 year ago (1 children)

Maybe some dns fail-over for lemmy.ml to point to join-lemmy.org might be cool indeed ๐Ÿค”

[โ€“] tmpod 2 points 1 year ago

Yeah, was thinking of a DNS based solution as well. Probably the easiest and most effective way to do it?

[โ€“] makingStuffForFun@lemmy.ml 14 points 1 year ago

We need Self hosted team and team networking to represent. Would be amazing to see some community support in scaling Lemmy up.

[โ€“] nutomic@lemmy.ml 11 points 1 year ago (1 children)

Can we replace Lemmy.ml with Join-lemmy.org when Lemmy.ml is overloaded/down?

I dont think so, when the site is overloaded then clients cant reach it at all.

Does LemmyNet have any plans on being Kubernetes (or similar horizontal scaling techniques) compatible?

It should be compatible if someone sets it up.

[โ€“] SemioticStandard@lemmy.ml 9 points 1 year ago (1 children)

You could configure something like a Cloudflare worker to throw up a page directing users elsewhere whenever healthchecks failed.

[โ€“] nutomic@lemmy.ml 18 points 1 year ago (4 children)

Then cloudflare would be able to spy on all the traffic so thats not an option.

[โ€“] SemioticStandard@lemmy.ml 7 points 1 year ago (2 children)

spy on all the traffic

That's...not how things work. Everyone has their philosophical opinions so I won't attempt to argue the point, but if you want to handle scale and distribution, you're going to have to start thinking differently, otherwise you're going to fail when load starts to really increase.

[โ€“] Cadende@lemmygrad.ml 10 points 1 year ago

Cloudflare does have the ability to spy on traffic though, they hold SSL keys.

You could run an interstitial proxy yourself with a little health checking. The server itself doesn't die, just the webapp/db. nginx could be stuck on there (if it's not already there) with a temp redirect if the site is timing out.

[โ€“] Cadende@lemmygrad.ml 3 points 1 year ago* (last edited 1 year ago)

A better option for a simple usecase like that is using something from your DNS provider. Depending on who you use they may have a health check service that has no access to user data that can simply ping a URL, and if it fails hard enough, start redirecting traffic to join-lemmy.org

I think Constellix has it, though I'm not necessarily recommending them specifically

[โ€“] sam_uk@slrpnk.net 2 points 1 year ago

How about https://deflect.ca/ they could still spy but probably less bad?