Is your AI provider serving the model it claims? Test it now

Proof of Model snapshots

Every check SPOT has run: what each endpoint claimed, what it really served, and the verdict.

Checks
97
0 live, 97 controlled
Fakes caught
48 of 50
96%
Real model passed
38 of 47
81%
Median check
14 s
on one NVIDIA L4
Tokens checked
1.6M
prompt and answer
GPU cost
$0.4211
all checks shown

All snapshots

Loading live checks...

Snapshot at (UTC)WhereClaimedActually servedVerdictScoreAnswers per questionTokensTimeSPOT was
2026-11-01 (19:01)spot-491bfdControlledQwen2.5-7B-InstructSmaller model (3B)Altered60×2028.5k15 sright
2026-11-01 (19:01)spot-5ae447ControlledQwen2.5-7B-InstructSmaller model (3B)Altered62×2028.3k16 sright
2026-11-01 (19:01)spot-1b3b48ControlledQwen2.5-7B-InstructSmaller model (3B)Altered64×2028.0k14 sright
2026-11-01 (18:59)spot-b8b330ControlledQwen2.5-7B-Instruct4-bit copyAltered24×2031.3k22 sright
2026-11-01 (18:58)spot-3e400aControlledQwen2.5-7B-Instruct4-bit copyAltered24×2031.6k22 sright
2026-11-01 (18:58)spot-d5fb5dControlledQwen2.5-7B-Instruct4-bit copyAltered24×2031.4k22 sright
2026-11-01 (18:56)spot-952631ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.71×2031.6k24 sright
2026-11-01 (18:56)spot-2c275fControlledQwen2.5-7B-InstructOfficial weightsGenuine0.66×2031.0k24 sright
2026-11-01 (18:56)spot-b83b99ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.73×2031.3k24 sright
2026-11-01 (18:55)spot-f0df89ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.76×2031.0k23 sright
2026-11-01 (18:55)spot-af8c95ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.71×2031.2k24 sright
2026-11-01 (18:54)spot-6b9a41ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.74×2031.3k23 sright
2026-11-01 (18:54)spot-ebcd9dControlledQwen2.5-7B-InstructOfficial weightsGenuine0.85×2031.3k23 sright
2026-11-01 (18:53)spot-34de01ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.74×2031.1k23 sright
2026-11-01 (18:10)spot-e4a104ControlledQwen2.5-7B-InstructSmaller model (3B)Altered75×2028.4k14 sright
2026-11-01 (18:09)spot-6fb4b7ControlledQwen2.5-7B-InstructSmaller model (3B)Altered76×2028.0k17 sright
2026-11-01 (18:09)spot-3c91e8ControlledQwen2.5-7B-InstructSmaller model (3B)Altered79×2028.1k14 sright
2026-11-01 (18:07)spot-7e8d29ControlledQwen2.5-7B-Instruct4-bit copyAltered30×2031.5k23 sright
2026-11-01 (18:07)spot-881429ControlledQwen2.5-7B-Instruct4-bit copyAltered28×2031.3k22 sright
2026-11-01 (18:07)spot-bf6169ControlledQwen2.5-7B-Instruct4-bit copyAltered28×2031.5k23 sright
2026-11-01 (18:05)spot-fe237cControlledQwen2.5-7B-InstructOfficial weightsGenuine0.92×511.2k13 sright
2026-11-01 (18:05)spot-963fb5ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.89×511.2k13 sright
2026-11-01 (18:04)spot-313ccaControlledQwen2.5-7B-InstructOfficial weightsGenuine0.91×511.2k13 sright
2026-11-01 (18:04)spot-e3124eControlledQwen2.5-7B-InstructOfficial weightsGenuine0.77×511.2k12 sright
2026-11-01 (18:04)spot-af20e3ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.88×2031.1k24 sright
2026-11-01 (18:03)spot-eb35f5ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.92×2031.2k24 sright
2026-11-01 (18:03)spot-c40ed8ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.90×2031.0k24 sright
2026-11-01 (18:02)spot-230771ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.83×2031.3k24 sright
2026-11-01 (18:02)spot-0b7151ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.92×2031.1k25 sright
2026-11-01 (18:01)spot-f8c9d5ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.83×511.2k13 sright
2026-10-31 (09:14)spot-77a904ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.82×511.1k14 sright
2026-10-31 (09:14)spot-20c4fdControlledQwen2.5-7B-InstructOfficial weightsAltered1.14×511.3k14 swrong
2026-10-31 (09:12)spot-411f0eControlledQwen2.5-7B-InstructSmaller model (3B)Altered36×510.4k11 sright
2026-10-31 (09:07)spot-282b66ControlledQwen2.5-7B-Instruct4-bit copyAltered12×511.3k12 sright
2026-10-31 (09:01)spot-e562d0ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.88×511.2k14 sright
2026-10-28 (14:52)spot-eb15fbControlledQwen2.5-7B-InstructOfficial weightsGenuine0.85×511.3k14 sright
2026-10-28 (14:52)spot-32ddf1ControlledQwen2.5-7B-InstructSmaller model (3B)Altered34×510.5k12 sright
2026-10-28 (14:52)spot-8ee068ControlledQwen2.5-7B-Instruct4-bit copyAltered13×511.3k15 sright
2026-10-28 (14:51)spot-f0abd7ControlledQwen2.5-7B-InstructSmaller model (3B)Altered39×510.5k29 sright
2026-10-28 (14:51)spot-ae8504ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.91×511.4k31 sright
2026-10-28 (14:51)spot-601e73ControlledQwen2.5-7B-Instruct4-bit copyAltered11×511.3k29 sright
2026-10-28 (14:42)spot-0e8093ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.86×511.2k9 sright
2026-10-28 (14:42)spot-a71b93ControlledQwen2.5-7B-InstructSmaller model (3B)Altered33×510.6k12 sright
2026-10-28 (14:42)spot-018362ControlledQwen2.5-7B-Instruct4-bit copyAltered12×511.2k13 sright
2026-10-28 (14:42)spot-631443ControlledQwen2.5-7B-InstructOfficial weightsAltered1.06×511.2k12 swrong
2026-10-28 (14:41)spot-e56313ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.94×511.2k17 sright
2026-10-28 (14:41)spot-74bedfControlledQwen2.5-7B-InstructSmaller model (3B)Altered31×510.6k8 sright
2026-10-28 (14:41)spot-fdf24aControlledQwen2.5-7B-Instruct4-bit copyAltered14×511.2k10 sright
2026-10-28 (14:41)spot-4b3bd8ControlledQwen2.5-7B-InstructOfficial weightsAltered1.13×511.3k10 swrong
2026-10-28 (14:38)spot-fd1557ControlledQwen2.5-7B-InstructOfficial weightsGenuine0.94×511.3k9 sright

Score: distance from the real model; up to 1.00× is normal. More answers per question makes a check surer; the live demo uses 10.

Research sweep

Each open model served the honest way and as cheaper copies on our GPUs, then checked. 30 copies caught, 4 missed, 45 honest setups.

ModelServed asResult
Gemma-4-26B-A4BOfficial weights (reference)reference
Gemma-4-26B-A4BOfficial weights, another honest setuppassed
Gemma-4-26B-A4BOfficial weights, another honest setuppassed
Gemma-4-26B-A4BOfficial weights, another honest setuppassed
Gemma-4-26B-A4BOfficial weights, another honest setuppassed
Gemma-4-26B-A4Bchanged settingcaught
Gemma-4-26B-A4Bdifferent modelcaught
Gemma-4-26B-A4B4-bit copycaught
Gemma-4-26B-A4BFP8 copycaught
Gemma-4-31BOfficial weights (reference)reference
Gemma-4-31BOfficial weights, another honest setuppassed
Gemma-4-31BOfficial weights, another honest setuppassed
Gemma-4-31BOfficial weights, another honest setuppassed
Gemma-4-31BOfficial weights, another honest setuppassed
Gemma-4-31Bchanged settingcaught
Gemma-4-31Bdifferent modelcaught
Gemma-4-31Bdifferent modelcaught
Gemma-4-31B4-bit copycaught
Gemma-4-31BFP8 copycaught
Mistral-Nemo-12BOfficial weights (reference)reference
Mistral-Nemo-12BOfficial weights, another honest setuppassed
Mistral-Nemo-12BOfficial weights, another honest setuppassed
Mistral-Nemo-12BOfficial weights, another honest setuppassed
Mistral-Nemo-12BOfficial weights, another honest setuppassed
Mistral-Nemo-12Bdifferent modelcaught
Mistral-Nemo-12B8-bit int copycaught
Mistral-Nemo-12B4-bit copycaught
Mistral-Nemo-12Bfp8 KV cachenot caught
Mistral-Nemo-12BFP8 copyrun didn't finish
Qwen2.5-7BOfficial weights (reference)reference
Qwen2.5-7BOfficial weights, another honest setuppassed
Qwen2.5-7BOfficial weights, another honest setuppassed
Qwen2.5-7BOfficial weights, another honest setuppassed
Qwen2.5-7BOfficial weights, another honest setuppassed
Qwen2.5-7BOfficial weights, another honest setuppassed
Qwen2.5-7Binjected system promptcaught
Qwen2.5-7BFP8 copycaught
Qwen2.5-7B8-bit int copynot caught
Qwen2.5-7B4-bit copycaught
Qwen2.5-7Bdifferent modelcaught
Qwen2.5-7Bdifferent modelcaught
Qwen3-30B-A3BOfficial weights (reference)reference
Qwen3-30B-A3BOfficial weights, another honest setuppassed
Qwen3-30B-A3BOfficial weights, another honest setuppassed
Qwen3-30B-A3BOfficial weights, another honest setuppassed
Qwen3-30B-A3BOfficial weights, another honest setuppassed
Qwen3-30B-A3Bdifferent modelcaught
Qwen3-30B-A3BFP8 copycaught
Qwen3-30B-A3B4-bit copycaught
Qwen3-30B-A3Bfp8 KV cachecaught
Qwen3.5-9BOfficial weights (reference)reference
Qwen3.5-9BOfficial weights, another honest setuppassed
Qwen3.5-9BOfficial weights, another honest setuppassed
Qwen3.5-9BOfficial weights, another honest setuppassed
Qwen3.5-9BOfficial weights, another honest setuppassed
Qwen3.5-9BOfficial weights, another honest setuppassed
Qwen3.5-9BOfficial weights, another honest setuppassed
Qwen3.5-9BOfficial weights, another honest setuppassed
Qwen3.5-9BOfficial weights, another honest setuppassed
Qwen3.5-9BOfficial weights, another honest setuppassed
Qwen3.5-9Bchanged settingcaught
Qwen3.5-9Bdifferent modelcaught
Qwen3.5-9Bdifferent modelcaught
Qwen3.8-27BOfficial weights (reference)reference
Qwen3.8-27BOfficial weights, another honest setuppassed
Qwen3.8-27BOfficial weights, another honest setuppassed
Qwen3.8-27BOfficial weights, another honest setuppassed
Qwen3.8-27BOfficial weights, another honest setuppassed
Qwen3.8-27Bchanged settingcaught
Qwen3.8-27Bdifferent modelcaught
Qwen3.8-27BFP8 copynot caught
Qwen3.8-27Bfp8 KV cachenot caught
gpt-oss-120bOfficial weights (reference)reference
gpt-oss-120bOfficial weights, another honest setuppassed
gpt-oss-120bOfficial weights, another honest setuppassed
gpt-oss-120bOfficial weights, another honest setuppassed
gpt-oss-120bOfficial weights, another honest setuppassed
gpt-oss-120bchanged settingcaught
gpt-oss-120bdifferent modelcaught
gpt-oss-20bOfficial weights (reference)reference
gpt-oss-20bOfficial weights, another honest setuppassed
gpt-oss-20bOfficial weights, another honest setuppassed
gpt-oss-20bOfficial weights, another honest setuppassed
gpt-oss-20bOfficial weights, another honest setuppassed
gpt-oss-20bOfficial weights, another honest setuppassed
gpt-oss-20bOfficial weights, another honest setuppassed
gpt-oss-20bOfficial weights, another honest setuppassed
gpt-oss-20bchanged settingcaught
gpt-oss-20bdifferent modelcaught