AI Hardware Performance Rankings
Welcome to our AI Performance Rankings page. Here, we evaluate the components based on their AI processing power, measured in TOPS (Tera Operations Per Second) – a critical metric indicating the computational throughput, particularly for AI tasks.
The first column shows peak performance for INT8/FP8 precision, which is the most widespread metric for evaluating AI inference capabilities. We exclude Sparsity to provide a more accurate reflection of AI performance in dense computation scenarios where sparsity optimizations may not be applicable. The second and third columns show the performance with Sparsity, and FP4 TFLOPS, when supported.
For SoCs, the results reflect the peak performance of the integrated NPU. Additionally, it’s important to note that, according to Microsoft, a NPU must have at least 40 TOPS of AI computing power for the PC to be considered “AI-capable.”
| # | Type | GPU / CPU (NPU) | TOPS INT8/FP8 No Sparsity | TOPS INT8/FP8 Sparsity | TFLOPS FP4 Sparsity | Prices from... |
|---|---|---|---|---|---|---|
| 1. | mobile | NVIDIA GeForce RTX 5090 (Laptop) | 363 | 726 | 1452 | $3818.09 |
| 2. | mobile | NVIDIA RTX 5000 Ada Generation (Laptop) | 341 | 682 | — | $3579.00 |
| 3. | mobile | NVIDIA GeForce RTX 4090 (Laptop) | 318 | 636 | — | $2349.00 |
| 4. | mobile | NVIDIA GeForce RTX 5080 (Laptop) | 281 | 562 | 1124 | $2249.99 |
| 5. | mobile | NVIDIA GeForce RTX 4080 (Laptop) | 271 | 542 | — | $2099.00 |
| 6. | mobile | NVIDIA RTX 4000 Ada Generation (Laptop) | 258 | 516 | — | $3098.00 |
| 7. | mobile | NVIDIA Quadro RTX 6000 (Laptop) | 238 | — | — | Check Price |
| 8. | mobile | NVIDIA GeForce RTX 5070 Ti (Laptop) | 209 | 418 | 836 | $1299.93 |
| 9. | mobile | NVIDIA RTX A5500 (Laptop) | 198 | — | — | $3667.24 |
| 10. | mobile | NVIDIA GeForce RTX 3080 Ti (Laptop) | 189 | 378 | — | $1499.99 |
| 11. | mobile | NVIDIA RTX A5000 (Laptop) | 174 | 348 | — | $3399.99 |
| 12. | mobile | NVIDIA GeForce RTX 5070 (Laptop) | 173 | 346 | 692 | $1199.99 |
| 13. | mobile | NVIDIA GeForce RTX 3080 (Laptop) | 168 | 336 | — | $1250.00 |
| 14. | mobile | NVIDIA GeForce RTX 4070 (Laptop) | 160 | 320 | — | $760.15 |
| 15. | mobile | NVIDIA GeForce RTX 2080 SUPER (Laptop) | 153 | — | — | $2729.00 |
| 16. | mobile | NVIDIA Quadro RTX 5000 (16GB GDDR6, Laptop) | 152 | — | — | $7999.00 |
| 17. | mobile | NVIDIA GeForce RTX 2080 (Laptop) | 150 | — | — | $2599.00 |
| 18. | mobile | NVIDIA RTX A4000 (Laptop) | 142 | 284 | — | $1669.00 |
| 19. | mobile | NVIDIA GeForce RTX 3070 Ti (Laptop) | 140 | 280 | — | $1089.99 |
| 20. | mobile | NVIDIA Quadro RTX 5000 Max-Q (16GB GDDR6) | 133 | — | — | $3999.77 |
| 21. | mobile | NVIDIA GeForce RTX 5060 (Laptop) | 133 | 266 | 532 | $949.99 |
| 22. | mobile | NVIDIA GeForce RTX 3070 (Laptop) | 133 | 266 | — | $999.99 |
| 23. | mobile | NVIDIA Quadro RTX 4000 (Laptop) | 128 | — | — | $1929.93 |
| 24. | mobile | NVIDIA RTX 3500 Ada Generation (Laptop) | 127 | 254 | — | $2576.77 |
| 25. | mobile | NVIDIA RTX 3000 Ada Generation (Laptop) | 125 | 250 | — | $2799.77 |
| 26. | mobile | NVIDIA GeForce RTX 4060 (Laptop) | 116 | 232 | — | $809.99 |
| 27. | mobile | NVIDIA GeForce RTX 2070 SUPER (Laptop) | 113 | — | — | $1099.00 |
| 28. | mobile | NVIDIA Quadro RTX 4000 Max-Q | 113 | — | — | $2479.77 |
| 29. | mobile | NVIDIA GeForce RTX 2070 (Laptop) | 107 | — | — | $998.79 |
| 30. | mobile | NVIDIA RTX 2000 Ada Generation (Laptop) | 105 | 210 | — | $1500.00 |
| 31. | mobile | NVIDIA GeForce RTX 3060 (Laptop) | 105 | 210 | — | $699.00 |
| 32. | mobile | NVIDIA RTX A3000 (Laptop) | 102 | 204 | — | $1969.77 |
| 33. | mobile | NVIDIA GeForce RTX 4050 (Laptop) | 97 | 194 | — | $589.99 |
| 34. | mobile | NVIDIA GeForce RTX 2060 (Laptop) | 96 | — | — | $649.99 |
| 35. | mobile | NVIDIA Quadro RTX 3000 (Laptop) | 86 | — | — | $2008.07 |
| 36. | mobile | NVIDIA Quadro RTX 3000 Max-Q | 85 | — | — | $4176.96 |
| 37. | mobile | NVIDIA RTX A2000 (Laptop) | 74 | 148 | — | $1159.77 |
| 38. | mobile | NVIDIA GeForce RTX 3050 Ti (Laptop) | 69 | 138 | — | $699.99 |
| 39. | mobile | NVIDIA RTX A1000 (Laptop) | 60 | — | — | $743.38 |
| 40. | mobile | NVIDIA RTX A500 (Laptop) | 58 | — | — | $949.93 |
| 41. | mobile | NVIDIA GeForce RTX 3050 (Laptop) | 57 | 114 | — | $554.85 |
| 42. | mobile | NVIDIA GeForce RTX 2050 (Laptop) | 48 | 96 | — | $537.00 |
| 43. | mobile | NVIDIA GeForce MX570 | 48 | 96 | — | $970.77 |

![[May 2026] Amazon Global: Top 10 Best-Selling Gaming Laptops – Budget-Friendly ASUS TUF Gaming A15 Dominates the Market](https://laptopmedia.com/wp-content/uploads/2026/06/Best-Selling-Gaming-Laptops-GLOBAL-Top-10-400x225.jpg)
![[May 2026] Amazon Global: Top 10 Best-Selling Laptops – Apple’s Affordable ‘MacBook Neo’ Takes the Crown Amidst Strong Air and Pro Sales](https://laptopmedia.com/wp-content/uploads/2026/06/Best-Selling-Laptops-GLOBAL-Top-10-400x225.jpg)
![[May 2026] Best-Selling Laptop Brands on Amazon Global – Apple Dominates in Units and Revenue](https://laptopmedia.com/wp-content/uploads/2026/06/GLOBAL-Best-Brands-400x225.jpg)


Great ranking, will there be any for phones ?
Thank you, Rado. Compiling such a ranking involves a lot of work, but if this one gains interest, we’ll definitely consider expanding in that direction to include phones as well.
Is it a good idea to buy RTX 4090 for a server, instead of NVIDIA L40, given the much lower price, considering the similar performance?
If you’re building a server, one important reason to favor the L40 is its passive cooling. Maintaining fans isn’t ideal for systems that must operate 24/7 over the long term.
This is gold, I hope that you’ll keep it updated!
Please consider adding more info about the GPUs.
would love the option to exclude same gpus.
instead of dozens of rtx4090, for example:
nvidia 4090 (max) 800 400 …
nvidia 4090 (min) 780 390 …
No AMD?