It seems like a lot of video cards are trending towards blower style designs which don't vent hot air inside the case, so if you have one of those it's probably not a big deal.
On my Asus Z270i, the M.2 that's right there has a heatsink too.
On my Asus Z270i, the M.2 that's right there has a heatsink too.