this post was submitted on 12 Jun 2023
173 points (98.3% liked)

Lemmy.World Announcements

29024 readers
8 users here now

This Community is intended for posts about the Lemmy.world server by the admins.

Follow us for server news 🐘

Outages πŸ”₯

https://status.lemmy.world

For support with issues at Lemmy.world, go to the Lemmy.world Support community.

Support e-mail

Any support requests are best sent to info@lemmy.world e-mail.

Report contact

Donations πŸ’—

If you would like to make a donation to support the cost of running this platform, please do so at the following donation URLs.

If you can, please use / switch to Ko-Fi, it has the lowest fees for us

Ko-Fi (Donate)

Bunq (Donate)

Open Collective backers and sponsors

Patreon

Join the team

founded 1 year ago
MODERATORS
 

I'm trying to fix this annoying slowness when posting to larger communities. (Just try replying here...) I'll be doing some restarts of the docker stack and nginx.

Sorry for the inconvenience.

Edit: Well I've changed the nginx from running in a docker container to running on the host, but that hasn't solved the posting slowness..

top 50 comments
sorted by: hot top controversial new old
[–] ge_generation@lemmy.world 36 points 1 year ago

Thank you Ruud for hosting! Your work is much appreciated.

[–] HypersonicRaven@lemmy.world 11 points 1 year ago

Thanks for hosting this great instance! We appreciate all you're doing!

[–] 00Lemming@lemmy.world 9 points 1 year ago* (last edited 1 year ago)

Godspeed to you over the coming days man. Really appreciate you putting this together and the extra work it takes when tackling something like this (both being new to the platform and the tech still being in relative infancy) - not to mention the crazy scaling happening. I will definitely be pitching in to help make sure the server stays up!!

[–] MiddleWeigh@lemmy.world 8 points 1 year ago

Thanks a bunch! I'll be donating for what it's worth. I really like it here.

[–] zikk_transport2@lemmy.world 6 points 1 year ago (2 children)

Hey. From my own experience - Nginx is awesome and fast when it is working, but the more you want from it, the more difficult it becomes.

Give Caddy a try. This reverse proxy has always been excellent for me. It has HTTP3 (QUIC) support, automatic ACME and overall excellent configuration in terms of simplicity and user friendliness.

Caddy is not a good choice if you need TCP/UDP proxy. It's only HTTP/HTTPS proxy.

[–] god@lemmy.world 1 points 1 year ago* (last edited 1 year ago) (1 children)

Someone said this about Caddy "it injects advertising headers into your responses". Is this true? I don't know anything about caddy but that doesn't sound too good lo (to be fair it could be misinformation).

[–] zikk_transport2@lemmy.world 3 points 1 year ago* (last edited 1 year ago) (3 children)

Never heard about it. This is open source project, free to use.

In case you want to understand why it's good, check out Caddyfile example. Just specify something like this:

example.com {
  reverse_proxy backend:1234
}

And that's it! It automatically binds on 0.0.0.0:80 only for redirects to 0.0.0.0:443 + using ACME adds TLS, all behinds the scenes.

Add 1 more line to my given example and it adds compreasion.

I've been using it for my self-hosted stuff for prob 1-2 years and it kept working flawlessly all the time. Very satisfied.

load more comments (3 replies)
[–] mo_ztt@lemmy.world 6 points 1 year ago

Hey, I just want to echo what everyone else is saying - thanks much for hosting + all the efforts to keep things working well. It's appreciated πŸ‘

Well worth any inconvenience, thank you so much for hosting!

[–] TRBoom@lemmy.world 5 points 1 year ago

Good luck today lol

[–] ruud@lemmy.world 5 points 1 year ago (1 children)

2 restarts done already :-)

[–] ruud@lemmy.world 3 points 1 year ago (1 children)

Hmm. I guess the delay in posting is not related to nginx. I now have the same conf as a server that doesn't have this issue.

load more comments (1 replies)

Thanks for putting in the time to make this run smoothly

[–] mikehunt@lemmy.world 5 points 1 year ago (1 children)

Thank you so much for this amazing instance!

[–] ruud@lemmy.world 2 points 1 year ago

You're welcome!

[–] azura@fedia.io 4 points 1 year ago (1 children)

Hehe, the joys of troubleshooting and profiling. Isn't it fun?

[–] ruud@lemmy.world 5 points 1 year ago (1 children)

Hmm if it takes too long the fun disappears... ;-)

[–] azura@fedia.io 7 points 1 year ago

You got this. <3
I don't have experience scaling Lemmy, but I do have experience scaling stuff in general. I'm sure you've got a few people here who'd be willing to talk things through with you if you get too frustrated.
And don't forget to breathe and step back if you have to. Your well being is more important.

[–] TangoGolfXRay@lemmy.world 4 points 1 year ago

Thanks for hosting.

[–] MyOpinion@lemmy.world 4 points 1 year ago* (last edited 1 year ago) (2 children)
[–] BackOnMyBS@lemmy.world 4 points 1 year ago

username s out

[–] simple@lemmy.world 3 points 1 year ago

Lots of instances are getting hugged to death. lemmy.ml and beehaw.org aren't even loading for me anymore.

[–] slapmefive@lemmy.world 4 points 1 year ago

Thank you, Ruud!

[–] animist@lemmy.one 3 points 1 year ago (6 children)

Since I have you here, if I start my own instance do I absolutely have to use docker? I've never had good experiences with it and would rather just install programs the old-fashioned way

[–] sunaurus@lemm.ee 2 points 1 year ago* (last edited 1 year ago) (1 children)

Docker is not necessary, lemm.ee for example is running without docker!

Here is documentation for setting it up: https://join-lemmy.org/docs/en/administration/from_scratch.html

Of course you can fully adapt it to your own use case. The Lemmy backend is a single binary, you don't even need to build it on the same machine which will run it. There's no hard requirement to use nginx or anything like that either - if you understand what this guide is doing, you can replace all the unimportant parts as needed.

load more comments (1 replies)
load more comments (5 replies)
[–] slimerancher@lemmy.world 3 points 1 year ago (2 children)

Something is weird.

I opened this post from main page "subscribed listing", but the title showed "I can't find any cannabis cultivation community", but the comments were same. I initially thought I have opened a wrong post, but the comments were mentioning "Good work Ruud", so I refreshed and it fixed post's title.

Have you noticed the issue?

[–] TRBoom@lemmy.world 5 points 1 year ago

I've noticed a couple oddities as well.

  • I refresh a page and a completely different page loads instead
  • An autorefresh hits the community tab, but it loads up 10 posts from a single community I'm sure it'll get sorted out eventually lol
[–] TeaHands@lemmy.world 1 points 1 year ago (2 children)

It's happened to me a few times as well (not just on this instance, think it's a bug in Lemmy itself). So far I'e not found a reproducible pattern though so it's a tricky one to bug report effectively.

load more comments (2 replies)
[–] simple@lemmy.world 3 points 1 year ago (2 children)
[–] ruud@lemmy.world 9 points 1 year ago

Thanks! Hadn't seen, but changed that (also to 512!) yesterday.

[–] bitrate@lemmy.world 4 points 1 year ago

That is definitely a good lead

[–] necrxfagivs@lemmy.world 3 points 1 year ago

Keep up the good work!
I joined this instance and also mastodon.social, first time using the Fediverse and as excited as confused lol

[–] madmonki@lemmy.world 3 points 1 year ago

thanks for everything!

[–] Dick_Justice@lemmy.world 3 points 1 year ago

Thank you! Sounds like a lot of work.

[–] slashzero@hakbox.social 3 points 1 year ago* (last edited 1 year ago) (2 children)

Somehow I don’t think the slowness when posting or saving is due to the nginx server / reverse proxy running inside the Lemmy container.

I would think it’s related to inserts and updates in the DB, but I haven’t had time to look into it on my instance, sorry!


Edit wait! Posting and saving is fast now! What did you change? Nicely done! πŸ‘

[–] ruud@lemmy.world 5 points 1 year ago (1 children)

No it's not! Not for me anyway. Yes I'll be looking into that, but first migrate the server!

[–] slashzero@hakbox.social 2 points 1 year ago* (last edited 1 year ago)

Oh wait, that’s because I’m posting to Lemmy.world from my instance. It’s only slow when posting to Lemmy.world from a Lemmy.world user.

With that in mind, it makes me think it has something to do with some insert or update that happens. My local DB is not under load, so my save is fast. Lemmy.world’s DB is under load so the save is slow.

It might not even be the insert/update that is slow. Could be some other insert into another table that gets triggered on save that is the culprit.

[–] veroxii@lemmy.world 3 points 1 year ago (1 children)

Posting seems faster when posting to a non-local federated community. Maybe that's what you experienced?

[–] slashzero@hakbox.social 2 points 1 year ago

You are right. Good catch.

[–] ZeroDrek@lemmy.world 2 points 1 year ago

As others have said, thanks for hosting. I also have an account at mastodon.world so I had to join here. ;)

load more comments
view more: next β€Ί