It's the opportunity cost. At low and moderate speeds (we're talking delta-Vs of 10 km/s and less), the same tankage simply gives you higher performance with chemical propulsion, so for no size of tankage may it actually be advantageous to use an NTR instead of a chemical engine. Only at extreme delta V levels do NTRs actually get better performance, but that's not a mission-to-Mars territory. LANTRs could possibly lower the crossover point, especially with variable Isp, but properly estimating how much requires calculus of variations, as I already said elsewhere.
> As to fuel - don’t get it from heavy bodies. Mine asteroids, minor moons, whatever.
Same issue. Your supply may be limited and/or require effort to extract. NTRs throw oxygen away; hydrolox and methalox engines use it for propulsion. For every tonne of water extracted, you'll go MUCH further if you go chemical, or at least with LANTR instead of NTR.