Oh please. I had a "Raw" poster on my closet door I got from the video rental place in Portsmouth, Rhode Island in the '80s. He was pretty mainstream at that point. It's hard to tease apart the fact some of "Delirious" is about how crappy he was as a comedian at the start because he just made poop jokes vs. him talking about Mr. T rodgering people.
SNL, 48 Hours, Beverly Hills Cop series, Coming to America, Golden Child, Trading Places, Nutty Professor, PJs...
He wasn't "mainstream" with respect to G and PG audiences, and wasn't on "regular" TV shows much. He did tours and cable specials like "Delirious" and "Raw" for the 'adult' market. But he was pretty much everywhere in the 80s, in multiple hit movies and cable specials (and radio charts!) in pretty much every year of the 80s in the to 90s.
Another way to put it - he was about as 'mainstream' as a black entertainer was allowed to be in the 80s. That he dealt more in 'adult' stuff vs 'family' stuff (like Cosby) was his own choice, of course, but he no doubt broke a hell of a lot of barriers in those years.