With lately’s shocking revelation that it’s possible to cheat Android benchmark apps, it’s worth a quick reminder that we’ve always been able to manipulate Android benchmarks. And, frankly, it shouldn’t come as any surprise that manufacturers do everything they can to score as high as possible.
I quite fondly recall sitting in a Hell’s Kitchen bar in 2011, just hours after the launch event for the original Samsung Galaxy S. I had a brand new Motorola Droid X in my pocket — announced just a week prior — and (now former) Samsung engineers asking to see how it benchmarked. Not knowing better at the time, I happily obliged.
Here’s the thing: We have only ourselves to blame for this nonsense.
Android sites — ourselves included for some time — have long made a big deal about benchmarks. And here’s why: They’re easy to do. Fire up an app and a video camera, and watch the fun begin. “It benchmarks 9,000!!!” is a joke we still make today, long after Android Central stopped worrying about benchmarks.
Anyhoo. Or own Jerry Hildenbrand back in May 2011 walked us through just how easy it is to manipulate benchmark apps through software — by no means thoughts what Samsung’s doing now, optimizing for explicit apps. Are you able to actually blame Samsung, although? Fanatics and bloggers make a huge deal about benchmarks. Why would not the producers do the whole thing they are able to to attain as excessive as imaginable?
The place it will get shady, after all, is that Samsung is controlling the CPU for particular apps, and now not precisely in a clear method.
“They will have to have a checkbox within the settings that claims ‘Run in full throttle,’ ” mentioned Marcus Adoflsson, founder and CEO of Cellular Countries.
I am inclined to agree. However these don’t seem to be Samsung’s apps. It might behoove the app builders to in all probability level out simply how the hardware is interacting with the tool. The use of extra cores than with different apps? Inform me.
However on the other hand, if anyone’s going to recreation the device we helped create, we mustn’t act so shocked.