Taking physicalism to be true, imagine that determinism is false. What is non-determinism but randomness? And how can one's actions being partly random be called "free will"? So regardless of whether one's actions are pre-determined or not, they're not "free" because that notion breaks down under close examination. Either actions are determined or they are wholly or partially random. This is the case if you're a physicalist, but also if you're a dualist. If the mind exists in some realm other than the physical world, that realm operates either deterministically or partly or wholly randomly. The same line of argument applies to neutral monism.
Emergentism is the only one that works differently, but I don't put much stock in gesturing vaguely at the morass of mind and matter and saying "the explanation is somewhere in here". In any case, if an emergentist can give a description of a component of mind that isn't reducible to matter, the same argument will apply to it.