If things are that simple, how do you explain slow crushes? When you meet someone and initially don't feel any attraction, but when you repeatedly interact with them and learn more about them, you start enjoying their company more and looking forward to being with them and at some point you realize you're in love?
This exists and, from both my own experience and that of others, is not uncommon.