If your kids are forced into remote learning, and you're working from home, then we might be talking more like 3-4 Mbps per person if your network is split 5 or 6 ways. And unless you're on a business internet plan, the only guarantee you have when you buy a 20Mbps plan is that your ISP will throttle you to that rate if you exceed it.
To be clear: I think most people would be happy if they could get a guarantee of 50 Mbps download speeds. But the fact of the matter is that during peak hours, if you pay for higher download speeds, you get a higher fraction of the available spectrum. Your big-name cable companies can have oversubscription rates of 100x or more. That doesn't translate to only getting 5Mbps out of your 500Mbps connection at peak, but you will see _some_ contention. If you're paying for 20Mbps under the assumption that you'll only need 18Mbps at peak, you'll be frustrated when you end up only getting 15Mbps and all the video calls stutter / cut out intermittently.