Despite the company’s denial last month, Samsung has been found by multiple reputable testers to cheat on benchmark tests. According to reports, several Samsung smartphones and tablets crank up the heat when they detect benchmark tests being performed. The problem seemingly extends beyond just Samsung though, and several other vendors including HTC and LG apparently juice their benchmark tests as well. Now, it looks like benchmark test providers are starting to fight back.
As noted by The Register, benchmark test creator Futuremark has publicly shamed Samsung and HTC by removing several of their devices from its website. The site ranks smartphones and tablets according to their performance on its 3Dmark test for Android, which measures graphics performance on mobile devices.
So far, Futuremark has delisted Samsung’s Galaxy Note 3 smartphone as well as the company’s flagship Galaxy Note 10.1 tablet. From the HTC camp, the One and One mini have both been banned from the site’s rankings as well.
“The platform may not detect the launch of the benchmark executable,” Futuremark’s regulations clearly state. “The platform must not alter, replace or override any parameters or parts of the test, nor modify the usual functioning of the platform based on the detection of the benchmark.”