Their goal isn't to look pretty, it's to sell stuff. There have been many times when i've been looking at something on amazon, clicked the one-click purchase button, and then hours later realized i wasn't really sure i wanted to buy it, Amazon just makes it far too easy to give them my money.
Amazon likes to give me similar hardware when I search for a part, cluttering up the results with things I don't want. If I search for a 7850 GPU, I don't want results for a 6950, 7950, 6870, 7770, 7870, Intel 3570K CPU, GTX 670, Intel 2500K CPU, GTX 480, 6850, GTX 560 Ti, and GTX 560. That was all just on the first page of search results.
Granted, you do want similar products in other cases, but the same kind of failure applies elsewhere.
Another annoying thing is the duplicate items as separate listings. Sometimes I will go and look for something like a Water Filter replacement and find 3 or 4 different listings for the product with multiple sellers under each.
Using Amazon to find a specific product is an unpleasant experience. Thankfully once you find the product you are looking for everything else is great.
I think I was caught in a little bit of Silicon Valley myopic thinking since their site isn't shiny and that's what is mistakenly considered as interchangeable with good UI design these days. That being said, Amazon.com the site does still need to improve UX in a couple key areas. Compared to more contemporary e-commerce sites, the ability to compare items and make sense of ratings (i.e. the flaws of the 5 star rating system) is where they need to make the most improvement IMHO.
It may have been an overstatement to say "their site leaves much to be desired" in all fairness.
I hate that I need to log in 3 times within the space of 5 minutes as I hit different parts of the site that apparently are considered more and more sensitive.
I hate the way they keep on misleadingly suggesting that items might be eligible for free shipping when they aren't (every possible signal from the user profile to ip geo-location should be indicating that I'm the wrong country for that).
I despise the way they keep on defaulting me back to paying in the wrong currency with their rip-off "amazon currency converter" with worse exchange rates than my credit card.
I can't believe that in this day and age they aren't able to synchronize anything except the most rudimentary profile data across their different domains. So the US site will keep on recommending a DVD I've already bought off the UK site, and the UK one will nag me about rating a book that I've already rated on the US one.
That's just a few things off the top off my head, not some long held grudge list.