You're probably right - I think a lot of people have a fundamental misunderstanding of severity and statistics here. As far as I can tell, if you have respiratory "cold"/"flu" symptoms, it's most likely that it's COVID, just based on prevalence and contagiousness.
Also, a lot of people haven't had the flu in years - it's not mild. It's often a week of being miserable in bed, not two days of sniffles. Mild COVID can feel like a cold, but COVID is more contagious and (I believe) more prevalent at this point. If you have any of those symptoms, you should probably assume it is COVID and take a test if you need to be around others.