Files

Rank the boards.

The table below is generated by RankCards, using the timings found in the /ncnn/benchmark/README.md file.
First, the best set of timings is selected from each board.
The set is then compared to a reference set by calculating the ratio of each model one by one and averaging all results.
Finally, the boards are ranked from fast to slow.

Board Ratio
1 NVIDIA Quadro RTX 8000 (TU102 SM x 72 + Tensor Core x 576) 0.147
2 nVIDIA RTX2080 of Desktop 0.15
3 NVIDIA GeForce RTX 3060 Ti of Desktop[2023-10-12] 0.18
4 nVIDIA RTX2060 of Notebook 0.198
5 Intel® Core™ i7-13700K of Desktop[2023-10-12] 0.255
6 AMD Radeon RX 6900 XT of Desktop[2023-10-12] 0.275
7 NVIDIA RTX3090 (GA102 SM x 82 + Tensor Core 328) 0.277
8 MediaTek Dimensity 9300 (MT6989) (Cortex-X4 3.25 GHz + 2.85 GHz x 3 + Cortex-A720 2.0 GHz x 4 + Mali-G720-Immortalis MC12) 0.309
9 MacBook Pro (13-inch, M1, 2020) 0.346
10 AWS c5.4xlarge Instance 0.418
11 AMD Ryzen 9 5950X 16-Core of Desktop[2023-10-12] 0.427
12 Qualcomm SM8550-AB Snapdragon 8 Gen 2 (Kyro 3.20 GHz + 2.8 GHz x 2 + 2.80 GHz x 2 + 2.00 GHz * 3 + Adreno 740) 0.45
13 AMD Ryzen 5700g (Zen3 3.8 GHz ~ 4.6 GHz x 8) 0.478
14 HUAWEI KunPeng 920 3211K (x24 cores) 0.482
15 NVIDIA Jetson AGX Orin (Cortex-A78AE 2.2 GHz x 12 + Ampere@1.3 GHz Tensor Cores 64) 0.485
16 HUAWEI KunPeng 920 2251K (x8 cores) 0.54
17 nVIDIA RTX A3000 of Notebook (6GB) 0.577
18 Intel(R) UHD Graphics 770 of Desktop[2023-10-12] 0.593
19 OrangePi5, Rockchip RK3588s (Quad Core A76 2.4GHz + Quad Core A55 1.8GHz) 0.642
20 Qualcomm SM8150-AC Snapdragon 855+ (Kyro485 2.96 GHz + 2.42 GHz x 3 + 1.80 GHz x 4 + Adreno 640) 0.665
21 Rockchip RK3588 (Quad Core A76 2.4GHz + Quad Core A55 1.8GHz) 0.753
22 NVIDIA Jetson Orin Nano 0.819
23 Raspberry Pi 5 Broadcom BCM2712, Cortex-A76 (ARMv8) (2.4GHz x 4) 1
24 Station-M3/ROC-RK3588S-PC, Rockchip RK3588S (Quad Core A76 2.4GHz + Quad Core A55 1.8GHz + Mali-G610) StationOS (Android) 1
25 NVIDIA Jetson AGX Xavier (Carmel 2.2 GHz x 8 + Volta Tensor Cores 64) 1.05
26 Loongson 3A6000 (LA664 2.5GHz * 4+4) 1.11
27 Hyper-V Linux Guest with GPU-PV enabled (Intel Core i7-11800H, NVIDIA GeForce RTX 3070 Laptop GPU) 1.19
28 Rockchip RK3588 (Cortex-A76 2.4GHz x 4 + Cortex-A55 1.8GHz x 4) 1.35
29 NVIDIA Jetson TX2 NX(NV-Denver2 2.0Ghz x 2 + Cortex-A57 2.0Ghz x 4 + 256-core NVIDIA Pascal iGPU) 1.59
30 Hyper-V Linux Guest with GPU-PV enabled (Intel Core i7-7700K, NVIDIA GeForce GTX 1050 Ti) 1.66
31 Phytium FT-2000+/64 (FTC662 armv8 2.4GHz x 8) 1.75
32 AMD Ryzen Threadripper 3970X (Zen2 3.7 GHz ~ 4.5 GHz x 32) 2.19
33 AMD Ryzen Embedded V1605B (Zen 2.0 GHz ~ 3.6 GHz x 4 + Radeon Vega 8 1.1GHz 8CU) 2.23
34 Avaota Aim T527, Allwinner T527 (Cortex-A55 2.2GHz x 4 + Cortex-A55 1.8GHz x 4) 2.28
35 Loongson 3A5000 (LA464 2.5GHz * 4) 2.31
36 Qualcomm MSM8996 Pro Snapdragon 821 (Kyro 2.35GHz x 2 + Kyro 2.19GHz x 2) 2.37
37 NVIDIA Jetson Nano 2.44
38 Intel Celeron N5105 2.8
39 Loongson 3A4000 (GS464V 1.8GHz * 4 with MSA128) 3.24
40 Khadas VIM3, Amlogic A311D (Cortex-A73 2.2GHz x 4 + Cortex-A53 1.8GHz x 2) 3.48
41 Kirin 970 (Cortex-A73 2.4GHz x 4 + Cortex-A53 1.8GHz x 4) 3.58
42 Qualcomm MSM8998 Snapdragon 835 (Kyro 2.45GHz x 4 + Kyro 1.9GHz x 4 + Adreno 540) 3.63
43 MacBook Pro (15-inch, 2019) - 2.6GHz six cores Intel Core i7 && Radeon Pro 555X 4GB && Intel UHD Graphics 630 1536MB 3.75
44 Qualcomm MSM6150 Snapdragon 675 (Kyro460 2.0GHz x 2 + Kyro460 1.7GHz x 6 + Adreno 612) 3.75
45 Qualcomm MSM8994 Snapdragon 810 (Cortex-A57 2.0GHz x 4 + Cortex-A53 1.55GHz x 4) 3.82
46 Station P2, Rockchip RK3568 (Cortex-A55 2.0GHz x 4) 3.85
47 Rock3A, Rockchip RK3568 (Cortex-A55 2.0GHz x 4) ubuntu 20.04 3.86
48 Loongson 3A4000 (GS464V 1.8GHz * 4 with MSA128) 4.08
49 Radxa Zero 3W, Cortex-A55 (ARMv82) (1.416 GHz x 4) 4.5
50 Raspberry Pi 4 Model B Broadcom BCM2711B0, Cortex-A72 (ARMv8) (1.8GHz x 4) 4.95
51 OrangePi4 LTS, Rockchip RK3399 (Cortex-A72 1.8GHz x 2 + Cortex-A53 1.5GHz x 4) 5.11
52 Rockchip RK3399 (Cortex-A72 1.8GHz x 2 + Cortex-A53 1.5GHz x 4) 5.16
53 PhytiumPi, Phytium E2000 (FTC664@1.8GHz x2 + FTC310@1.5GHz x2) 5.16
54 Qualcomm SDM660 Snapdragon 660 (Kyro260 2.2GHz x 4 + Kyro260 1.84GHz x 4 + Adreno 512) 5.26
55 Phytium FT-2000/4 (FTC663 armv8 2.2GHz x 4) 5.27
56 RDK X3 Module (Cortex-A53 1.5GHz x 4) aarch64 5.88
57 Station-M2/ROC-RK3566-PC, Rockchip RK3566 (Cortex-A55 1.8GHz x 4 + Mali-G52) StationOS (Android) 6.51
58 Rockchip RK3288-CG.W (Cortex-A17 1.8GHz x 4) 6.66
59 Qualcomm MSM8916 Snapdragon 410 (Cortex-A53 1.2GHz x 4) 7.63
60 NanoPi R2S, Rockchip RK3328 (Cortex-A53 1.3GHz x 4) Armbian focal (21.05.1) aarch64 7.66
61 Intel Atom x5-Z8350 7.74
62 Loongson 2K2000 (LA364 1.5GHz * 2 with lsx) 8.23
63 EAIDK 310, Rockchip RK3228H (Cortex-A53 1.3GHz x 4) fedora-28 aarch64 8.34
64 OrangePi Zero 2, Allwinner H616 (Cortex-A53 1.5GHz x 4) 9.51
65 Raspberry Pi 3 Model B+ Broadcom BCM2837B0, Cortex-A53 (ARMv8) (1.4GHz x 4) 9.87
66 iPhone 5S (Apple A7 1.3GHz x 2) 11
67 MYIR RemiPi,Renesas RZG2L(Cortex-A55 1.5GHz x 2) 11.9
68 Raspberry Pi 5 Broadcom BCM2712, VideoCore VII Graphics (Vulkan 1.2) 12.5
69 Raspberry Pi Zero 2 W Broadcom BCM2710A1, Cortex-A53 (ARMv8) (1.0GHz x 4) 13.7
70 Xeon Phi 3120A (1.10 GHz 57-core 228-thread) 15.1
71 Loongson 3A3000 (GS464E 1.45GHz * 4) 16.3
72 AXERA AX620A (Cortex-A7 1.0GHz * 4) 18.8
73 Loongson 2K1000LA (LA264 1.0GHz * 2) 24.4
74 Loongson 2K1000 (GS264 1.0GHz x 2) 24.8
75 Freescale i.MX7 Dual (Cortex A7 1.0GHz x 2) 26.7
76 Banana Pi M2 Zero 2 AllWinner H2+, Cortex-A7 (ARMv7-A) (1.2GHz x 4) 26.8
77 HiSilicon Hi3519V101 (Cortex-A17 1.2GHz x 1) 36.2
78 Sunway SW831 (sw_64 2.5GHz * 8) 40.7
79 Z7-Lite 7020 XC7Z020CLG400-2 (Cortex-A9 766MHz x 2) 43.2
80 Intel Celeron M 420 (Yonah 1.60 GHz x 1) 43.9
81 Amlogic S805 (Cortex-A5, 4 × 1.536GHz) 45.9
82 VisionFive2 , JH7110 (SiFive-U74(RV64GC) 1.5GHz x 4) riscv64 with PowerVR B-Series BXE-4-32 72.4
83 T-Head TH1520 (C910V, 1.848 GHz x 4 + BXM-4-64 PowerVR) 83.3
84 Sunway SW421 (sw_64 1.7GHz * 4) 116
85 Ingenic T40XP Xburst2 Core X2 1.4Ghz (without MSA) 165