Is your AI provider serving the model it claims? Test it now
Blog
What we measure while building SPOT, with the numbers behind it.
In our demo game the 4-bit copy of Qwen2.5-1.5B usually answers first. We went through 222 GPU runs to see whether speed can expose a copy anywhere else.