Is mobile phone scoring software reliable?
Is mobile phone scoring software reliable?

In recent years, a new method has emerged to measure the quality of a mobile phone - scoring, and various scoring software and standards have emerged in endlessly. For manufacturers, scoring software is also a knotty problem. If the score is high, it can be used as a means of publicity. If the score is low, it will be criticized. For users, is the actual reference level of the scoring software high? This paper introduces and analyzes some commonly used scoring software and methods.

Here's a description. The introduction of this article focuses on the Android platform. The iOS platform and the Windows Phone platform will have fewer applications in this regard due to the highly unified hardware of their own systems.

 

1. Evaluation of rabbit

I believe you will not be surprised to put "Little Rabbit" at the first place. This is a necessary software for Android mobile phone evaluation. It evaluates the overall performance of the system, including RAM, CPU, GPU, I/O, SD card performance, etc. Recently, it was upgraded to version 3.0.3. Compared with the previous version 2.9. X, the new OpenGL ES 2.0 GPU test has been added. Therefore, the test scores of some machines with high-end GPUs will rise sharply and gradually open the score gap.

 

Anthare has also developed the WP version. Of course, it is meaningless to compare it with Android.

Analysis of reliability: ★★★☆

From the CPU side, due to the separate scoring of multithreading and floating point performance, Qualcomm's krait architecture will score high here, but its general performance is not so powerful. In terms of GPU, after the introduction of new test methods, the reference value is much higher than before. In terms of SD card, there is a big gap in actual reading speed, but there is not much difference in scores, which is also related to the focus of the software.

Advantage platform: APQ8064

 

2.Geekbench

This is a cross platform testing software, which not only allows Android and iOS to compete on the same platform, but also can participate in PC and Mac testing (don't think about making horizontal comments on computers and mobile phones...). It involves CPU integer, floating point, memory and other test items. There are many sub items in the score of each large item, which is very useful for data analysis, but not useful for ordinary users. After the running of iPhone 5, there was a case of Android phones getting together to run Geekbench 2. Everyone was happy to "kill" iPhone 5

Analysis of reliability: ★★★☆

The proportion of floating point operations is too large, which will show that some SoCs have overwhelming advantages. As a measure of the pure computing power of CPU and Ram, it has some reference value. The goal here was to give a high score, but because the stability of Geekbench is very low, there is often a gap of several hundred points between two tests. It takes several measurements to test the real level of the product.

Advantage platform: Exynos 5250

 

3. Quadrant Advanced quadrant run

This is a running score software popular from a single core, which has gradually been replaced by Anthare, and involves many projects, including CPU, RAM, I/O and GPU.

Analysis of reliability: ★★☆

This scoring software has little reference value. First of all, the partial load of the GPU is too low to reflect the gap. What's more, the Tegra3 high-frequency version is even higher than APQ8064 and Exynos4412... Not to mention the I/O aspect. In the past, there were many ways to cheat on the I/O part of this scoring software. This software focused too much on the I/O part, It seems that the score has no great reference value.

Advantage platform: APQ8064, Tegra3 high-frequency version

 

4. Vellamo web benchmark

This is a mobile web ruler tool, which has now been divided into HTML5 and Metal modules, of which HTML5 module includes our commonly used web javascript scoring Sunspider, Google V8, etc.

The figure below shows Xiaomi 2, One X+and Note II from left to right.

 

The following figure shows the most adverse Nexus 10

Analysis of reliability: ★★★★

In principle, this is a software launched by Qualcomm. It should have a high score when running with Qualcomm's CPU, but the actual effect surprised the author. The scores of Exynos4412 and Tegra3 were higher than APQ8064, which proves that Qualcomm did not seem to optimize its own CPU. This software is really "conscience". Among them, the HTML5 part is particularly valuable for reference, which includes all aspects of tests such as Javascript performance, web page dragging and sliding, and can truly reflect the advantages and disadvantages of CPU general performance. Of course, points are deducted here because the Metal part does not have much reference value.

Advantage platform: Exynos 5250

 

5.Nenamark

GPU scoring software, which uses some 3D scenes to test the GPU performance of mobile phones, has now launched version 2.4.

The figure below shows Xiaomi 2 engineering machine, which exceeds 60fps.

Analysis of reliability: ★★★

The load of this software is too low. Most GPUs can be full frames, so the referential value is low. However, the difference in the scores of the same GPU used in different models can be referred to. For example, some Tegra3+720P phones cannot reach full frames. In addition, this software also takes resolution into account, so it is not completely fair.

Advantage platform: some models of APQ8064 and K3V2 have high scores because some of them do not lock 60FPS.

 

6.GLBenchmark

This is a large-scale GPU performance test software, of course, the professionalism is also obvious to all. The latest version 2.5 has further increased the pressure on polygon and shader calculation, so the strength of performance squeezing will be greater than the general GPU test. It is divided into two modes. One is OnScreen, which runs tests at the resolution of the machine. The other is Offscreen, which runs tests at a unified 1080P resolution. The latter can directly compare the actual performance of GPU.

The following is the score of the strongest iPad 4 under off screen.

Degree of reliability: ★★★☆

The performance test of this software is very accurate, which can intuitively reflect the difference of GPU computing performance. As shown in the figure below, the score is directly related to GPU computing performance.

Advantage platform: A6X

 

Other scoring methods

In addition to some scoring software, we can also use other methods to measure the performance of mobile phones. The following are some test methods that accurately reflect the SoC performance:

Sunspider

Sunspider is a web page Javascript performance scorer that tests CPU single thread performance and is sensitive to CPU frequency. The lower the score, the better. This web page scoring is greatly influenced by the browser, and the Android platform will play well using Baidu Browser+"T5" kernel. The iOS and WP platforms can reach a high level by using their own Safari and IE.

 

Google V8

The performance score of Javascript launched by Google is similar to that of Sunspider.

 

FPS Meter

This is a software used by Android platform to measure the real-time frame number. We use it to measure the real-time frame number of images, which is generally used in games, simulators, etc.

 

simulator

For example, GBA and NDS simulators can be considered, which is also a more intuitive way to measure the general performance of CPU. There is also a new PSP simulator called "PPSSPP", which is not very mature for the time being. It is believed that it will become a benchmark for measuring CPU performance in the future.

 

Soft solution video

This is another way to test the general performance of the CPU. It will use CPU multithreading.

 

The author believes that it is necessary to run the score test, which can objectively measure the hardware performance of mobile phones. The mobile phone user experience with high scores may not be good, but it is not realistic for the mobile phone user experience with low scores to reach a high level. In addition to the absolute performance of the hardware, the overall experience of the mobile phone is greatly related to system optimization and UI settings. Therefore, we can only see the absolute performance of the mobile phone hardware through scoring, which does not represent the overall performance of the entire mobile phone.

 

Learn more about new cool devices, stay tuned

 

Related links:

Full interpretation of refusing to fool mobile GPU (II)

Full interpretation of refusing to fool mobile GPU (I)

Rational view of 1080P full HD mobile phone

Mobile CPU asynchronous multi-core and large and small core

How to improve the image quality of Android games?

What is the multi core of mobile GPU?

Mobile RAM, ROM and memory card

How to better protect the power key of your phone?

What can OTGs of mobile phones and tablets do?

 

Share:
Igao7 Feiwei
edit
If you don't brush the machine, don't overclock, and don't bother, you will die
Share Weibo Share WeChat
 Aigoji WeChat

Aigoji WeChat

 WeChat

WeChat

Recommended products

Sorry, the product you are looking for is not available in the product library

on trial