Upvote I used to dig BeautifulSoup. It's latest release is slower than it's predecessors. That's why I use PyQuery nowadays, it's based on lxml and uses a jQuery like API to access the DOM.
I'm always terrified that these conversations will unearth a library or technique that will immediately obsolete most of the code in my current pet project.
Thanks!
I highly reccomend PyQuery. It's basically the jQuery API on top of lxml.
any chance of this running in IronPython?
Don't quote me on this, but I believe you can get this running by way of IronClad. (AFAIK lxml doesn't run on IronPython without using IronClad right now.)
I forgot what BeautifulSoup couldn't do that made me look for something else, but I've been using html5lib for those purposes these days with good results, especially if you need to output modified HTML.