A new Qualcomm mobile benchmark standard based on user experience will be introduced soon. The company has teamed up with Berkeley Design Technology, Inc. to develop the new rating system.
According to Qualcomm’s announcement, this scheme will be more relevant to consumers as it will show statistics that will be crucial in deciding whether or not to purchase a particular device. For instance, it will prove the answer to the question of how many hours of battery life one will get when performing specific activities, such as web browsing or gaming. Another example that Qualcomm cites is calculating how many milliseconds it would take for a device to calculate pi. Other measurements will reflect data transfer speeds and app performance, according to Berkeley Design Technology, Inc. Qualcomm furthermore mentioned that the upcoming scheme will be more transparent since it would give primary importance to the user experience.
Qualcomm also announced that its move is a reaction to the controversy that surrounded the accuracy and relevance of mobile benchmarking tests recently. For one, there is the allegation that the AnTuTu mobile benchmark test is more partial towards Intel architecture over ARM. This doubt surrounding mobile benchmarking is what impelled Qualcomm to seek change. The company believes that such change is crucial for both manufacturers and consumers as it could restore the integrity of benchmark test results as it shows user experience more accurately.
The new Qualcomm mobile benchmark standard will have to compete against those that are currently available. Some of these are Vellamo, Quadrant, GLBenchmark, Geekbench 2, AnTuTu, SunSpider, GLBenchmark. Apart from the cheating claim, benchmark tests have been criticized for being irrelevant. The Mostly Tech blog once published an article saying that many of these tests measure only performance and ignoring power consumption and fail to measure real-world performance. Some may be too old to be relevant while others, too new. Some, also, do not work across platforms, or may be difficult to repeat. Lastly, the scores of a particular device may change once the operating system receives an upgrade. Here’s hoping that the new Qualcomm mobile benchmark standard will not bring about these same concerns.