this post was submitted on 08 Jan 2024
348 points (96.0% liked)

Announcements

23170 readers
2 users here now

Official announcements from the Lemmy project. Subscribe to this community or add it to your RSS reader in order to be notified about new releases and important updates.

You can also find major news on join-lemmy.org

founded 5 years ago
MODERATORS
 

Sometime early this morning, our database started having issues, most likely due to a disk corruption issue.

Unfortunately the postgres database was unrecoverable, and we had to restore from a nightly backup, so a few hours of posts and comments will be missing.

Apologies again for the downtime, and for the disruption.

you are viewing a single comment's thread
view the rest of the comments
[–] v_krishna@lemmy.ml 33 points 8 months ago (4 children)

How does lemmy federation work in this case? Conceivably after being restored from backup the lemmy.ml instance could see those few hours of lost history as federated to other lemmy instances and resync it back as the host instance. Obv I'm vastly oversimplifiying things but what happens today?

[–] dessalines@lemmy.ml 18 points 8 months ago (2 children)

I believe they're lost, as recieved apub content doesn't have the original post / comments, but I'm not totally sure. cc @nutomic@lemmy.ml

[–] ada@lemmy.blahaj.zone 16 points 8 months ago (1 children)

It strikes me that there is the potential to use trusted remote servers as a means of recovering the lost data. I mean, nearly every lemmy instance except lemmy.ml will have copies of the missing data, and given the hugely redundant availability of that data (including the ability to compare from multiple sources to establish/verify trust), using that data to rebuild missing content seems like it could be useful functionality.

[–] heyfrancis@lemmy.ml 3 points 8 months ago

If I understand, federating contents through ActivityPub only works once. Sounds a good feature to re-download contents again, but may introduce additional work as there should be some way to know if a content is missing then another job to rebuild

load more comments (1 replies)