It's true that it takes less effort to drive. Easier to drive by just using one leg and easier to use one arm. But the loss of control is real, at least for me.
One example is moving from zero to non-zero. If I just release the break while standing still, the car slowly accelerates, too slowly. If I gently press the accelerator pedal, same problem. If I press is slightly more, the car accelerates too much. There doesn't seem to be a sweet-spot anywhere for a smooth but fast "takeoff", which is easy to achieve with my manual car.
Another example is highway driving and wanting to accelerate to pass someone. Sometimes the car decides that when I press the accelerator (while driving in 120km/h already), to shift down a gear to be able to speed up faster, but it's completely unnecessary, just go faster instead.
Last pet peeve is reversing. Instead of pressing the accelerator to go backwards, you release the brake pedal. But this again is hard to find a sweetspot and I end up doing stop-slow-stop-slow-stop... and so on, instead of just smoothly backwards without stopping, while being to adjust the speed.
Overall, I can't wait to get back to my car with manual transmission, so I can have a smooth driving experience again.