Speed and memory are measured on-device, while quality is evaluated on an H100.
Share of distinct raw submissions by runtimes.
Measured on the submitted device. Performance methodology
Run on the H100 and scored server-side. Result publication methodology