this post was submitted on 06 Aug 2023
1191 points (98.9% liked)

Announcements

23319 readers
1 users here now

Official announcements from the Lemmy project. Subscribe to this community or add it to your RSS reader in order to be notified about new releases and important updates.

You can also find major news on join-lemmy.org

founded 5 years ago
MODERATORS
 

This is an opportunity for any users, server admins, or interested third parties to ask anything they'd like to @nutomic@lemmy.ml and I about Lemmy. This includes its development and future, as well as wider issues relevant to the social media landscape today.

Note: This will be the thread tmrw, so you can use this thread to ask and vote on questions beforehand.

Original Announcement thread

you are viewing a single comment's thread
view the rest of the comments
[–] hruzgar@feddit.de 7 points 1 year ago (2 children)

Is there any limitations with the database (postgres)?. I know postgres is one of the best (maybe even best) monolith database (running on one node) at the moment, but will the space be enough? With this in mind, has there been any consideration of migrating to a distributed database like ScyllaDB or CassanraDB to alleviate potential space constraints? On the other hand, if Lemmy doesn't intend to store data for long periods, maybe the capacity of Postgres would suffice. Any thoughts or plans on this? I appreciate your insights on this matter.

[–] dessalines@lemmy.ml 13 points 1 year ago (1 children)

Disk space is definitely not an issue for us w/ postgres, or any text data really. The entire wikipedia english text data, is ~20GB. Images are the main disk-space concern for servers.

A backup of lemmy.ml's DB is only ~1.8 GB currently, and that's 3+ years of data.

We have no plans to move away from postgres, and lose all of its features and performance.

[–] oce@jlai.lu 5 points 1 year ago* (last edited 1 year ago)

ScyllaDB or CassanraDB

Distributed columnar databases are a different breed, migrating to that would not be trivial as it comes with a reduction of features compared to a traditional SQL databases, such as partial SQL support, bad join performances and lack of secondary indexes.