Yeah Photos app doesn’t do well with keyboard operation either. If you are in full screen mode, and you have gone from the grid to view a single photo, you might expect that the Esc key will take you back to the grid view, but no, it just exits full screen mode.
Same in the App Store app. There is no keyboard short cut to go back to the main list.