I do get these feelings of control, so I can't say I feel like a victim of my thoughts - "let them pass by", as you say, is mostly what I feel. But I think for some people, there's a question like:

"I thought I was the originator of many my out-of-the-blue thoughts, and I found out that's not true. Am I actually the originator of the thoughts at the next level up?".

I think some people who have never meditated, while they admit to having thoughts just hit them randomly sometimes, they'll nonetheless feel that many of their truly out-of-the-blue thoughts were conscious choices to switch gears or pull on an interesting thread. A meditator might label the same low-level thought as "random", but a non-meditator would say "I did that". Can a meditator similarly be fooled, on a different level?