The pilot of the Southwest flight 4712 was convinced it was a plane (and “a large one”). At no point he mentioned considering it to be something else. On top of that he reported following the thing “for some 100 miles”.
Also, not many currently declassified stealth aircraft fit the description of being large and white.
I don’t know if knowing this was a large plane flying faster than cruise jets is more concerning than not.