No one is ignoring that, and it's bizarre seeing people defend Musk in such a ridiculous fashion.
The plausible deniability angle would hit a little better if Musk hadn't also been endorsing a number of Nazi-adjacent parties and views, pushed literal white nationalist views repeatedly (which he has been doing for years -- he isn't concerned about birth rates, he is literally only worried about white birth rates while he runs his creepy birthing farm down in Texas, and that's aside from his endless "empathy is our weakness" attacks on migrants), and most recently literally excused Hitler on the basis that really it's the public servants who are to blame.
It's quite incredible really. If the guy wasn't already absolutely soaked with extremely far right rhetoric and beliefs -- save the absurd "oh he's a centrist" nonsense that zero people believe if they have any functioning grey matter at all -- it might have been excusable as something that just looked concerning.