Just tried it and it looks like you can long-press then swipe down to dismiss.
edit: it takes me about 2.5 seconds to dismiss a notification with that action. I don't know about y'all but I dismiss notifications way more often than open them. Seems like it should be just as quick to dismiss it as open it.