To partake in society you have to accept societal contracts. One such contract is to not be a dick to others. If you don't vaccinate yourself against certain things, you are liable for spreading the disease. And thus you are being a dick. And thus you break the contract.
If you excuse yourself from society going forward though, I see no problem with your stance.
It's different in Europe. When they say "rural", they mean any small town not adjacent to a city or other conurbation.
The density of small towns that have hundreds of years of history but are only 5-10km apart from the next 3-4 towns surrounding it are in a stark contrast to the 20-50km distances between North American towns. And rural farms are relatively rare. Farmers generally still live in the small town and then drive their tractor out to the fields.