It seems like the bureaus are the marketplaces; you just don't like their model for pricing and acquiring talent.
During the 2008 election, Rudy Giuliani was running as a Republican nominee. When his financial disclosures came out, he surprised everyone with how much he made on the speaking circuit. News orgs filed FOIA requests to see what universities and public institutions paid him to speak.
For some events, he'd speak in the same city to different groups. The price each group paid was wildly different (+/- 50k). The meeting planners hit the roof.
Speakers bureaus do not view meeting planners as their clients, the speakers are.