> Isn't this kind of leap?
No. Here are two specific examples:
1. The Cross Bronx Expressway, which basically created the South Bronx[1]. "The Power Broker" by Robert Caro is one of HN's most frequently recommended books, and covers this subject (as well as other racially-motivated planning projects by Robert Moses) extensively.
2. I-65 and I-165 in Mobile, AL cut directly through the historic "Africatown" neighborhood[2]. Residents regularly complain about both automotive and nearby industrial pollution, encouraged by ease of access by the highway[3].
Most of these effects are more visible on the East Coast rather than the West Coast, since the East's older and denser cities had fewer "paths of least resistance" when building the Interstate Highway System during the midcentury. But it wouldn't particularly surprise me if the areas that are now expensive in the cities that you mentioned were originally cleared for highways under "slum clearance" or similar laws.
Edit: This is anecdotal, but I figured I'd mention it anyways: I grew up in Manhattan, and virtually everybody I grew up with has (or had) asthma. Some of that is to be expected from other pollution sources (in particular, NYC used to burn very dirty heating oil), but I also went to public schools that were directly alongside major state and interstate highways.
[1]: https://en.wikipedia.org/wiki/Cross_Bronx_Expressway#Urban_d...
[2]: https://www.npr.org/2019/06/19/733996699/alabamas-africatown...
[3]: https://www.theguardian.com/us-news/2018/jan/26/africatown-s...