What model runs best on device?
Benchmark the most powerful foundation models across speed, latency,
memory, and quality on your device.
vs
Responsive & Accurate
More from the leaderboard for Mac Studio
Explore our benchmark data
Leaderboard
Compare model performance for your selected device and benchmarks.
Submission data
Browse every raw measurement behind the leaderboard. Speed and memory are measured on-device, while quality is evaluated on an AMD MI325X.
Preview program
Want to help us collect performance data?
Use our iOS and Android apps or clients to run benchmarks on your own devices. We are planning to add community submission support soon.
From the blog
The story behind Pipette
How Pipette benchmarks the speed, memory, and quality of foundation models on real devices, and why we built it.