Systems and software engineer here. I'm curious how the Lemmy project plans on scaling media uploads. It doesn't seem feasible to host on an instance server. Even Reddit had a problem with media over the years and some subs to this day enforce offloading media to third party.

[–] ruud@lemmy.world 0 points 1 year ago (1 children)

For now it's 2GB. I hope we can use block storage soon. I use Wasabi for mastodon.world

[–] huojtkeg@lemmy.world 0 points 1 year ago (1 children)

Just Postgres or Postgres + Pics? Could you give me the number for Postgres? I'm thinking in hosting my server but I have concerns abot scalability and costs in the future.

[–] ruud@lemmy.world 0 points 1 year ago (1 children)

du -sm *
2181	pictrs
1885	postgres

[–] huojtkeg@lemmy.world 0 points 1 year ago (1 children)

It seems a lot for little content. My experience tells me that Postgres is not going to scale well, some sort of NoSQL will be necessary.

[–] ruud@lemmy.world 0 points 1 year ago (1 children)

Why not? My mastodon DB is 200 GB, works fine.

[–] huojtkeg@lemmy.world 1 points 1 year ago* (last edited 1 year ago) (1 children)

It depends on many things like the number of tables, the indexes, etc... but Postgres doesn't work well above 1 TB. Anyway, it will take several years to reach that point. Someone will figure out a solution.

Thank you for the info. Do you have any link with the specs of your server, bandwidth, cpu/ram usage, statistics...? Anything that could help me to do the maths.

[–] ruud@lemmy.world 1 points 1 year ago (1 children)

[–] pcr3@lemmy.world 0 points 1 year ago (1 children)

I'm curious, how have the numbers changed in the last few weeks?

[–] ruud@lemmy.world 1 points 1 year ago (1 children)

Well we use a new server now, with 32 core/64 threads and 128GB RAM. So quite some more..

[–] pcr3@lemmy.world 1 points 1 year ago

haha that's awesome! keep up the good work.