There are overwhelmingly better fusion rocket ideas that take no detour through hot neutrons and heat.

Good old nuclear salt water rockets: https://www.npl.washington.edu/av/altvw56.html

Just don't point the exhaust at anything inhabited.