Depending on the altitude, they could keep these within class G airspace, which means VFR's job is to see and avoid. I think that's a pretty defensible solution as a pilot who spends all of his time in VFR operating in Class E/G airspace.