Hacker News Reader

Comment by nradov | Hacker News Reader

Instead of asking customers to give numeric star ratings, perhaps a better option would be a short list of Yes / No / Unsure questions. Were there clean sheets on the bed? Were there any cockroaches? Did the appliances work? Etc. Such questions are more objective and less prone to inflation.

View on HN

This is probably a much better way to do it. One of the food delivery company does it this way (I think it's grubhub/seamless). Three questions before you're given an option to review: 1. Was the food on time? 2. Was the order correct? 3. Was the food good? Only then is the person given the option to review.

The problem with star based rating systems is that they're INCREDIBLY subjective. I oftentimes read yelp reviews that are 3 star reviews where the person raves about the restaurant and then complains about a minor issue. I have a similar issue with app store ratings where I've had a rash of people rate one of my apps 1 star with the review text reading "I just downloaded this, I'll raise my review to 5 stars if love this app".

Also a lot of times on Amazon the low reviews are reflective of an issue with that particular sale instead of the item itself (ie damaged while shipping, etc).

Another annoyance is amazon not allowing rating separate editions of something. For example a bad kindle version resulted in bad ratings for Dune a few years ago. Sometimes certain versions of movies are bad while the movie in general is great.

Booking.com does it, btw. And I strongly prefer it.

Agree - it really helps you identify which parts of the experience are problematic. If the location is 8.7 where everything else is 9.5+, you know you'll be walking a distance to get anywhere useful. If the location is 9.5 while cleanliness is 7.8, you can consider the trade-off to be in the thick of things.

Surprised there is only one mention of Booking.com here. It is an indispensable tool for booking my vacations. The reviews are very useful and a lot more accurate than things like yelp. I have glanced at other websites, but nothing gives me the reassurance of the legitimacy of the reviews that booking.com does.

So do low end hostel sites, funnily enough. Arguably they need it more to distinguish between the places that are popular because they're clean, good value and quiet and the places that are popular because they have a very good (and loud) bar and a vendor who's very good at persuading people to go on his tours

They also require more time, and most people don't bother to leave reviews anyway.

But if you're going to review, a few extra seconds shouldn't matter

It's how the "official" reviews from Marriott/Hilton/etc all work

1. Require each person to answer one specific question per listing. Yes/no/almost

2. Ask each person a different objective question, intentionally filling in the gaps.

3. After a few people, you have an objective, relatively thorough view of the house, but you've not burdened any of your users with more than one question per stay.

The new review flow on Airbnb asks for more details about specific aspects of a listing.

Reply on news.ycombinator.com