Comment by masklinn | Hacker News Reader

Comment by masklinn | Hacker News Reader

> The phone giant has proved that benchmarking apps are vulnerable

The only thing they have proved is their willingness to game benchmarks. ATI and NVidia were gaming 3DMark 10 years ago.

Also interesting to note, though Samsung is definitely more than willing to game benchmark despite their protests (and looks like the worst offender by a pretty long shot), Anandtech found out they're far from the only company doing so: http://anandtech.com/show/7384/state-of-cheating-in-android-...

Edit: turns out this was mentioned in the article, but the way it's presented, what the fuck Guardian?

> Anandtech, a site where you could get the (wrong) impression that benchmarks are the only reason to own a gadget

Anandtech's Article:

Cheaters: Samsung, LG, Asus, HTC

non-cheaters: Motorola, Google, Nvidia, Apple

See any patterns?

Not really, care to enlighten me?

  Cheaters: Samsung, LG, Asus, HTC

Korean companies

  non-cheaters: Motorola, Google, Nvidia, Apple

US companies.

I for one can't help but see a slightly xenophobic pattern in the poster's comment.

ASUS and HTC are Taiwanese, not Korean.

I stand corrected.

Thanks

Still... Korea+Taiwan vs US.

This was a list of companies provided by Anandtech in its reporting. I just found it amusing that it happened to be a pattern in this set of data. Apologies!!

Let me guess: Suppliers of commodity hardware have an incentive to make that hardware look as attractive as possible, suppliers competing on other dimensions lie about other things ("We're open!, "It's magical")

Or did you mean something else?

Perfectly correct. The only way to produce real benchmarks is to run useful software that are identical on two different hardware setups. Sadly because of to DRM, this is impossible to do on lock down devices.

You could run two similar applications (say angry avialaes), but the only thing you would test is that device implementation of said game.

Reply on news.ycombinator.com