toggle

AAPL Stock: 113.51 ( + 0.22 )

Printed from http://www.macnn.com

Futuremark delists Samsung, HTC devices from benchmark rankings

updated 12:26 pm EST, Tue November 26, 2013

Inflated scores removed from benchmark listings after cheating discovered

Benchmark scores for smartphones and tablets from Samsung and HTC have been removed from one ranking site, after it was discovered that they were manipulated for a higher mark. Futuremark has delisted smartphones caught cheating its benchmarking app, including the HTC One and One Mini, and both processor variants of the Samsung Galaxy Note 10.1 and Galaxy Note III.

"People rely on Futuremark benchmarks to produce accurate and unbiased results. That's why we have clear rules for hardware manufacturers and software developers that specify how a platform can interact with our benchmark software," said Futuremark president Oliver Baltuch to The Register. "In simple terms, a device must run our benchmarks without modification as if they were any other application."



Initial reports of cheating found that the Samsung Galaxy Note 3 scored far higher than the LG G2, despite using the same 2.3GHz Qualcomm Snapdragon 800 processor. Earlier tests on the Samsung Galaxy S4 found code that allowed its CPU and GPU to run at maximum speed for benchmark applications, with a coded limit throttling normal use. Other items from HTC and Asus were added to the pile of devices that manipulated the results from benchmarks specifically, with other devices from the manufacturers in the future likely to undergo similar anti-cheating inspections.

Listings under Futuremark's 3DMark Android results currently show devices with the word "Delisted" instead of a performance score, and are ranked next to devices scoring 0 points, though the popularity score remains unchanged. Samsung and HTC can both appeal to Futuremark about the decision, though Futuremark also asks for users to report potentially fraudulent scores from other devices, so they can be inspected too.




by MacNN Staff

toggle

Comments

Login Here

Not a member of the MacNN forums? Register now for free.

toggle

Network Headlines

Follow us on Facebook

toggle

Most Popular

Advertisement

Recent Reviews

ZTE Spro 2 Smart Projector

Home theaters are becoming more and more accessible these days, but maybe you've been a bit wary about buying a home projector. And h ...

MSI Geforce GTX 970 100ME

When Nvidia announced a new line of video cards in September 2014, many people thought things would continue to be business as usual i ...

Wren V5US Wireless Sound System

If you're a music fanatic, chances are you are, by extension, a bit fanatical about what you listen to your music on. If you're like ...

toggle

Most Commented