Sure, could be rather hard to do in the night but once a stealth bomber is sighted visually, it is toast - B2 simply has no self defence weapons available at all.
A stealth fighter could be better off if it can defend itself while still avoiding others getting a weapon lock, effectively forcing them to use visually sighted cannon while it can use sensor guided gun and missiles normally.
And even then, aircraft like the B-2 are difficult targets to actually hit. At high altitudes they are fairly maneuverable due to low wing loading.
As for range - that's a good point, if your low fregvency or passive radar gives you a big bounding box, your fighters could run out of fuel before they find the stealth bomber. Or it might drop/launch its payload before you catch it.
It's sort of like if you're deer hunting and spot one through binoculars a mile from you moving away. You're going to have to get really lucky to take that deer.
Given that there are very few B2s, they're only going to be sent against the most valuable and well protected targets. Those are the most likely to have very alert defensive assets in exactly the right place to go after the B2s.