Proof of Model snapshots
Every check SPOT has run: what each endpoint claimed, what it really served, and the verdict.
- Checks
- 97 0 live, 97 controlled
- Fakes caught
- 48 of 50 96%
- Real model passed
- 38 of 47 81%
- Median check
- 14 s on one NVIDIA L4
- Tokens checked
- 1.6M prompt and answer
- GPU cost
- $0.4211 all checks shown
All snapshots
Loading live checks...
| Snapshot at (UTC) | Where | Claimed | Actually served | Verdict | Score | Answers per question | Tokens | Time | SPOT was |
|---|---|---|---|---|---|---|---|---|---|
| 2026-11-01 (19:01)spot-491bfd | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 60× | 20 | 28.5k | 15 s | right |
| 2026-11-01 (19:01)spot-5ae447 | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 62× | 20 | 28.3k | 16 s | right |
| 2026-11-01 (19:01)spot-1b3b48 | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 64× | 20 | 28.0k | 14 s | right |
| 2026-11-01 (18:59)spot-b8b330 | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 24× | 20 | 31.3k | 22 s | right |
| 2026-11-01 (18:58)spot-3e400a | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 24× | 20 | 31.6k | 22 s | right |
| 2026-11-01 (18:58)spot-d5fb5d | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 24× | 20 | 31.4k | 22 s | right |
| 2026-11-01 (18:56)spot-952631 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.71× | 20 | 31.6k | 24 s | right |
| 2026-11-01 (18:56)spot-2c275f | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.66× | 20 | 31.0k | 24 s | right |
| 2026-11-01 (18:56)spot-b83b99 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.73× | 20 | 31.3k | 24 s | right |
| 2026-11-01 (18:55)spot-f0df89 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.76× | 20 | 31.0k | 23 s | right |
| 2026-11-01 (18:55)spot-af8c95 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.71× | 20 | 31.2k | 24 s | right |
| 2026-11-01 (18:54)spot-6b9a41 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.74× | 20 | 31.3k | 23 s | right |
| 2026-11-01 (18:54)spot-ebcd9d | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.85× | 20 | 31.3k | 23 s | right |
| 2026-11-01 (18:53)spot-34de01 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.74× | 20 | 31.1k | 23 s | right |
| 2026-11-01 (18:10)spot-e4a104 | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 75× | 20 | 28.4k | 14 s | right |
| 2026-11-01 (18:09)spot-6fb4b7 | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 76× | 20 | 28.0k | 17 s | right |
| 2026-11-01 (18:09)spot-3c91e8 | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 79× | 20 | 28.1k | 14 s | right |
| 2026-11-01 (18:07)spot-7e8d29 | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 30× | 20 | 31.5k | 23 s | right |
| 2026-11-01 (18:07)spot-881429 | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 28× | 20 | 31.3k | 22 s | right |
| 2026-11-01 (18:07)spot-bf6169 | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 28× | 20 | 31.5k | 23 s | right |
| 2026-11-01 (18:05)spot-fe237c | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.92× | 5 | 11.2k | 13 s | right |
| 2026-11-01 (18:05)spot-963fb5 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.89× | 5 | 11.2k | 13 s | right |
| 2026-11-01 (18:04)spot-313cca | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.91× | 5 | 11.2k | 13 s | right |
| 2026-11-01 (18:04)spot-e3124e | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.77× | 5 | 11.2k | 12 s | right |
| 2026-11-01 (18:04)spot-af20e3 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.88× | 20 | 31.1k | 24 s | right |
| 2026-11-01 (18:03)spot-eb35f5 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.92× | 20 | 31.2k | 24 s | right |
| 2026-11-01 (18:03)spot-c40ed8 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.90× | 20 | 31.0k | 24 s | right |
| 2026-11-01 (18:02)spot-230771 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.83× | 20 | 31.3k | 24 s | right |
| 2026-11-01 (18:02)spot-0b7151 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.92× | 20 | 31.1k | 25 s | right |
| 2026-11-01 (18:01)spot-f8c9d5 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.83× | 5 | 11.2k | 13 s | right |
| 2026-10-31 (09:14)spot-77a904 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.82× | 5 | 11.1k | 14 s | right |
| 2026-10-31 (09:14)spot-20c4fd | Controlled | Qwen2.5-7B-Instruct | Official weights | Altered | 1.14× | 5 | 11.3k | 14 s | wrong |
| 2026-10-31 (09:12)spot-411f0e | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 36× | 5 | 10.4k | 11 s | right |
| 2026-10-31 (09:07)spot-282b66 | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 12× | 5 | 11.3k | 12 s | right |
| 2026-10-31 (09:01)spot-e562d0 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.88× | 5 | 11.2k | 14 s | right |
| 2026-10-28 (14:52)spot-eb15fb | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.85× | 5 | 11.3k | 14 s | right |
| 2026-10-28 (14:52)spot-32ddf1 | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 34× | 5 | 10.5k | 12 s | right |
| 2026-10-28 (14:52)spot-8ee068 | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 13× | 5 | 11.3k | 15 s | right |
| 2026-10-28 (14:51)spot-f0abd7 | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 39× | 5 | 10.5k | 29 s | right |
| 2026-10-28 (14:51)spot-ae8504 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.91× | 5 | 11.4k | 31 s | right |
| 2026-10-28 (14:51)spot-601e73 | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 11× | 5 | 11.3k | 29 s | right |
| 2026-10-28 (14:42)spot-0e8093 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.86× | 5 | 11.2k | 9 s | right |
| 2026-10-28 (14:42)spot-a71b93 | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 33× | 5 | 10.6k | 12 s | right |
| 2026-10-28 (14:42)spot-018362 | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 12× | 5 | 11.2k | 13 s | right |
| 2026-10-28 (14:42)spot-631443 | Controlled | Qwen2.5-7B-Instruct | Official weights | Altered | 1.06× | 5 | 11.2k | 12 s | wrong |
| 2026-10-28 (14:41)spot-e56313 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.94× | 5 | 11.2k | 17 s | right |
| 2026-10-28 (14:41)spot-74bedf | Controlled | Qwen2.5-7B-Instruct | Smaller model (3B) | Altered | 31× | 5 | 10.6k | 8 s | right |
| 2026-10-28 (14:41)spot-fdf24a | Controlled | Qwen2.5-7B-Instruct | 4-bit copy | Altered | 14× | 5 | 11.2k | 10 s | right |
| 2026-10-28 (14:41)spot-4b3bd8 | Controlled | Qwen2.5-7B-Instruct | Official weights | Altered | 1.13× | 5 | 11.3k | 10 s | wrong |
| 2026-10-28 (14:38)spot-fd1557 | Controlled | Qwen2.5-7B-Instruct | Official weights | Genuine | 0.94× | 5 | 11.3k | 9 s | right |
Score: distance from the real model; up to 1.00× is normal. More answers per question makes a check surer; the live demo uses 10.
Research sweep
Each open model served the honest way and as cheaper copies on our GPUs, then checked. 30 copies caught, 4 missed, 45 honest setups.
| Model | Served as | Result |
|---|---|---|
| Gemma-4-26B-A4B | Official weights (reference) | reference |
| Gemma-4-26B-A4B | Official weights, another honest setup | passed |
| Gemma-4-26B-A4B | Official weights, another honest setup | passed |
| Gemma-4-26B-A4B | Official weights, another honest setup | passed |
| Gemma-4-26B-A4B | Official weights, another honest setup | passed |
| Gemma-4-26B-A4B | changed setting | caught |
| Gemma-4-26B-A4B | different model | caught |
| Gemma-4-26B-A4B | 4-bit copy | caught |
| Gemma-4-26B-A4B | FP8 copy | caught |
| Gemma-4-31B | Official weights (reference) | reference |
| Gemma-4-31B | Official weights, another honest setup | passed |
| Gemma-4-31B | Official weights, another honest setup | passed |
| Gemma-4-31B | Official weights, another honest setup | passed |
| Gemma-4-31B | Official weights, another honest setup | passed |
| Gemma-4-31B | changed setting | caught |
| Gemma-4-31B | different model | caught |
| Gemma-4-31B | different model | caught |
| Gemma-4-31B | 4-bit copy | caught |
| Gemma-4-31B | FP8 copy | caught |
| Mistral-Nemo-12B | Official weights (reference) | reference |
| Mistral-Nemo-12B | Official weights, another honest setup | passed |
| Mistral-Nemo-12B | Official weights, another honest setup | passed |
| Mistral-Nemo-12B | Official weights, another honest setup | passed |
| Mistral-Nemo-12B | Official weights, another honest setup | passed |
| Mistral-Nemo-12B | different model | caught |
| Mistral-Nemo-12B | 8-bit int copy | caught |
| Mistral-Nemo-12B | 4-bit copy | caught |
| Mistral-Nemo-12B | fp8 KV cache | not caught |
| Mistral-Nemo-12B | FP8 copy | run didn't finish |
| Qwen2.5-7B | Official weights (reference) | reference |
| Qwen2.5-7B | Official weights, another honest setup | passed |
| Qwen2.5-7B | Official weights, another honest setup | passed |
| Qwen2.5-7B | Official weights, another honest setup | passed |
| Qwen2.5-7B | Official weights, another honest setup | passed |
| Qwen2.5-7B | Official weights, another honest setup | passed |
| Qwen2.5-7B | injected system prompt | caught |
| Qwen2.5-7B | FP8 copy | caught |
| Qwen2.5-7B | 8-bit int copy | not caught |
| Qwen2.5-7B | 4-bit copy | caught |
| Qwen2.5-7B | different model | caught |
| Qwen2.5-7B | different model | caught |
| Qwen3-30B-A3B | Official weights (reference) | reference |
| Qwen3-30B-A3B | Official weights, another honest setup | passed |
| Qwen3-30B-A3B | Official weights, another honest setup | passed |
| Qwen3-30B-A3B | Official weights, another honest setup | passed |
| Qwen3-30B-A3B | Official weights, another honest setup | passed |
| Qwen3-30B-A3B | different model | caught |
| Qwen3-30B-A3B | FP8 copy | caught |
| Qwen3-30B-A3B | 4-bit copy | caught |
| Qwen3-30B-A3B | fp8 KV cache | caught |
| Qwen3.5-9B | Official weights (reference) | reference |
| Qwen3.5-9B | Official weights, another honest setup | passed |
| Qwen3.5-9B | Official weights, another honest setup | passed |
| Qwen3.5-9B | Official weights, another honest setup | passed |
| Qwen3.5-9B | Official weights, another honest setup | passed |
| Qwen3.5-9B | Official weights, another honest setup | passed |
| Qwen3.5-9B | Official weights, another honest setup | passed |
| Qwen3.5-9B | Official weights, another honest setup | passed |
| Qwen3.5-9B | Official weights, another honest setup | passed |
| Qwen3.5-9B | Official weights, another honest setup | passed |
| Qwen3.5-9B | changed setting | caught |
| Qwen3.5-9B | different model | caught |
| Qwen3.5-9B | different model | caught |
| Qwen3.8-27B | Official weights (reference) | reference |
| Qwen3.8-27B | Official weights, another honest setup | passed |
| Qwen3.8-27B | Official weights, another honest setup | passed |
| Qwen3.8-27B | Official weights, another honest setup | passed |
| Qwen3.8-27B | Official weights, another honest setup | passed |
| Qwen3.8-27B | changed setting | caught |
| Qwen3.8-27B | different model | caught |
| Qwen3.8-27B | FP8 copy | not caught |
| Qwen3.8-27B | fp8 KV cache | not caught |
| gpt-oss-120b | Official weights (reference) | reference |
| gpt-oss-120b | Official weights, another honest setup | passed |
| gpt-oss-120b | Official weights, another honest setup | passed |
| gpt-oss-120b | Official weights, another honest setup | passed |
| gpt-oss-120b | Official weights, another honest setup | passed |
| gpt-oss-120b | changed setting | caught |
| gpt-oss-120b | different model | caught |
| gpt-oss-20b | Official weights (reference) | reference |
| gpt-oss-20b | Official weights, another honest setup | passed |
| gpt-oss-20b | Official weights, another honest setup | passed |
| gpt-oss-20b | Official weights, another honest setup | passed |
| gpt-oss-20b | Official weights, another honest setup | passed |
| gpt-oss-20b | Official weights, another honest setup | passed |
| gpt-oss-20b | Official weights, another honest setup | passed |
| gpt-oss-20b | Official weights, another honest setup | passed |
| gpt-oss-20b | changed setting | caught |
| gpt-oss-20b | different model | caught |