In the Fediverse, what is the solution to instances or servers going missing?
To elaborate: The problem with commercial aggregators like Reddit, Twitter/X, Facebook, etc. is enshitification, for one reason or another. Of course, Lemmy, etc. on the Fediverse is the alternative solution, seemingly. But let's say that the hardware for a large Lemmy instance just disappears. What happens to all of the posts? Yes, old posts will still be available for a while on other instances. But, seemingly, there won't be any more updates. How is this addressed?
Moderators would of course be interested in continuing but they may not have the skills and resources to set up the hardware.
Instances/servers can disappear for many reasons: retirement, illness, confiscation, war, bungee jumping or parachuting accident, ... the list goes on.
I know that people are using P40 and P100 GPUs. These are outdated but still work with some software stacks / applications. The P40 GPU, once very cheap for the amount of VRAM, is no longer as cheap as it was probably because folks have been picking them up for inference.
I'm getting a lot done with an NVidia GTX 1080 which only has 8GB VRAM. I can run a quant of dolphin Mixtral 7x8B and it works well enough. It takes minutes to load, almost too long for me, but after that I get 3-5 TPS with some acceptable delay between questions.
I can even run Miqu quants at 2 or 3 bits. It's super smart even at these low quant levels.
llama 3.1 8B runs great with this 1080 8BG GPU at 4_K_M and also 5 or 6_K_M. I believe I can run gemma 9B f16 at 8 bpw.