To be fair, the majority of YEA's come from Republicans, who control the House, and the majority of NAY's come from Democrats, who control the Senate. This has already died in the Senate once, so I wouldn't be surprised if that happens again.
Libertarians are probably the weakest leg of the Republican coalition. The religious right and the neocons are much stronger, the former has little reason to oppose this, the latter might be naturally inclined to support it.
Interestingly, I've been hearing a bit about Democratic-leaning "civil libertarians" -- people who want small government without buying into any of the Republican social agenda. Maybe there's a way to build a coalition that can take a big enough bite out of both parties to force them to take notice...