Risk?
That is my basic opposition. Happy to be flexible on energy in almost every way. Cost, type, uptime...
But error with nuclear tech tends to endure for a very long time. Fukushima will be raising ocean radiation for a long time, just one example.
These are many lifetime events. Some minor, or recoverable, some profound.
Given we can reasonably run the fridge on solar, and other tech, that risk does not seem to make sense to a lot of people.
Doesn't to me.
Now, that said I am not ideologically opposed. Other tech could very seriously improve risk profile. Maybe it becomes worth it.
Then again, the fridge in my RV can run on a small flame, or a very low current source. And no moving parts!
So, we could make fridges differently too. Make tradeoffs.