Are you suggesting a privatized National Weather Service and toll bridges would be better? If so, I have a nice bear-ridden town in New Hampshire you might like to move to.
Regulations are exactly how you deal with negative externalities.The EPA makes corporations pay for reducing pollution and cleanup. Why do you think corporations target EPA so much? Because EPA costs them money. Never hear any corporations whining about that free taxpayer-funded geological data coming out of USGS
I don't know where OP is, but here in Massachusetts, we have no sales tax on groceries:
https://www.salestaxhandbook.com/massachusetts/sales-tax-exemptions