Is it? I'm pretty sure oncologists will say "you have stage 2 breast cancer," but I wasn't in the room at the time.
But yeah, oncologists aren’t telling people “you have cancer” the way they might say “you have MRSA”.
Honestly, I think people probably get false impressions because cancer usually hits old people and old people are, frankly, often not reliable narrators.