Ranked by median cuda_kernel_launch_latency (us) across 7 gpu models. Lower is better - bars show the value, so a shorter bar is a better result.
# GPU model Median cuda_kernel_launch_latency Median Best Runs
1 NVIDIA RTX 2000 Ada Generation Laptop GPU 4.05 3.97 2
2 NVIDIA GeForce RTX 3060 Laptop GPU 4.11 4.11 1
3 NVIDIA RTX A5000 4.51 4.39 2
4 NVIDIA GeForce RTX 5090 4.67 4.67 1
5 NVIDIA RTX PRO 5000 Blackwell Generation Laptop GPU 5.67 5.55 3
6 NVIDIA H200 NVL 7.42 7.42 1
7 NVIDIA GeForce RTX 3060 Ti 7.66 7.66 1