Looks like that's a byproduct of Notion's keyboard shortcuts. I agree it's very annoying. Not only does it break arrow keys, but also home, end, page up, and page down.