Fediverse

28732 readers

253 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!

Rules

Posts must be on topic.
Be respectful of others.
Cite the sources used for graphs and other statistics.
Follow the general Lemmy.world rules.

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy

founded 2 years ago

MODERATORS

ruud@lemmy.world

Xylinna@lemmy.world

MrCenny@lemmy.world

TragicNotCute@lemmy.world

automodbeta@lemmy.world

woelkchen@lemmy.world

lemmony: A better "All" browsing experience for small Lemmy instances (github.com)

submitted 1 year ago* (last edited 1 year ago) by hawkwind@lemmy.management to c/fediverse@lemmy.world

32 comments fedilink hide all child comments

I made this tool to help self-hosters, new admins, or smaller instances have more global and updated content on their instances.

This is the similar to Lemmy Community Seeder but is designed to be run periodically to capture new communities, and include EVERYTHING by default.

EDIT: As noted in the comments, this is an admin tool. Please do not run it as a user if you don't know what you are doing. If you want a better "All," ask your admin first! That said, lemmony in no way constitutes abuse! You can cause a DOS with curl, but that's not what curl was written for. This tool is to legitimately use an API to enhance our experience. Admins that desire to accommodate high volume on a public service will not know this tool is running against, or on their instances. If it causes performance issues, that is unfortunate. They are free to throttle, ban or block API access to their instance in a multitude of ways.

EDIT 2: Donate to your instance/admin if you like Lemmy!

you are viewing a single comment's thread
view the rest of the comments

[–] iAmNotorious@lemmy.world 5 points 1 year ago (1 children)

Quite a bit of space could be saved with database compression. The database side of things has lower hanging fruit right now though.

[–] coldhotman@nrsk.no 2 points 1 year ago (1 children)

Really? Like a lot? I thought the biggest space hog was images by far.

[–] ipha@lemmy.world 2 points 1 year ago (2 children)

Images are not federated, they only live on the hosting instance.

Thumbnails might copied though, I'm not sure.

[–] SmashingSquid@notyour.rodeo 2 points 1 year ago (1 children)

Does the image get stores on the poster's instance or the instance hosting the community they're posting to?

[–] ipha@lemmy.world 2 points 1 year ago

The poster's.

[–] coldhotman@nrsk.no 1 points 1 year ago* (last edited 1 year ago) (1 children)

Hmm. Could you help me debug https://nrsk.no/post/160040, since the image from post https://lemmy.dbzer0.com/post/481984 is hosted at https://nrsk.no/pictrs/image/e899afcc-83fa-481e-b9d4-f5e0e693c1e3.jpeg?

I would initially think the image was federated as per the system design but you obviously know more about how my instance works than I do.

Any tips will greatly appreciated, I also suggest you make a github report since this is a bug every lemmy instance seems to struggle with.

[–] hawkwind@lemmy.management 1 points 1 year ago (1 children)

There is some discussion. https://github.com/LemmyNet/lemmy/issues/2947

I am still fairly confident that it shouldn't be storing images, but I'll admit my pict-rs directory is growing quite fast compared to the database. Have to keep a close eye on this.

[–] coldhotman@nrsk.no 0 points 1 year ago (1 children)

I am still fairly confident that it shouldn’t be storing images

If the lead developers discusses this not as a bug but an inconvenience then there's nothing I can ever say or show you to ever convince you otherwise.

Enjoy your non-proxying Lemmy experience - Since your pict-rs directory is growing but not due to your instance caching images it's probably the docker log bug that was discussed over a year ago.

[–] hawkwind@lemmy.management 1 points 1 year ago

I'm not convinced either one of us knows what the software is SUPPOSED to do, and I am pretty sure nobody knows what it's actually doing. Here's another thread: https://github.com/LemmyNet/lemmy/issues/3163