This is devoutly desired by most authors as being tarnished with the "SF Author" label is a ticket to lower pay and guilt-by-association-with-trash. Margaret Atwood furiously resists the idea that her stuff is Science Fiction because "SF is talking squids in outer space".
What often feels irritating about literary adventures into SF is that they allow themselves to loot the treasury of SF ideas and present them under respectable covers to readers who would never venture into the SF section (I view Atwood as a repeat offender in this department).
This is considerably less irritating than the bulk of the F/SF section, of course, which is 90% extruded paint-by-numbers escape literature. The average page count should be the first clue that 'we're not here for the ideas'. Thank goodness for the "Masterworks" series (and a few other lines) which do the admirable job of keeping something other than the Escape Lit du Jour in print.