You could buy fairly anonymously via certain methods on localbitcoins.com (or in person, etc).