Hi!
You make a good point, that the current behavior might not make sense on desktop. We started out on Android and iOS and there "tapping" on objects makes a whole lot more sense. We should probably revisit the entire controls logic in the future. In the meantime, try it out on mobile, might feel more fluid.