I think as we start defederating and making decisions we are setting up a dangerous situation where it becomes potentially easy to defederate for the wrong reasons.
Mastodon has operated this way for years and it's worked out really well. They're currently at 12 million or 13 million users right now. Read my comment I wrote on it here. Basically all the Nazis flee to the Nazi servers because they can't follow or subscribe to their fellow Nazis or talk about Nazi stuff. So they leave. This makes it safer for users and easier for mods to keep their users safe.
And like... sure, there's drama. People defederate for dumb reasons. But Mastodon accounts are portable and you can hop around from server to server easily. And 99% of the time people don't defederate for no reason.
Some religions and communities might have beliefs that appear to be pseudoscience or even discrimination.
This is often because they are. My old fundamentalist Christian cult I grew up in was incredibly homophobic. They 'looked' like they had beliefs that were discriminatory because they were. You do not get a 'be a bigot free' card because your religion says you are one. You can change your shitty religion (conservative fundamentalist religions have done so tons of times in the past). Minorities cannot change who they are. There are tons of other religious communities that do not discriminate against minorities so that standard is not unreasonable.