Editorial illustration for US benchmark shows China lagging; Deepseek model underperforms private tests
US benchmark shows China lagging; Deepseek model...
US benchmark shows China lagging; Deepseek model underperforms private tests
The US government has declared China's best AI model is falling behind. It's a political verdict.
DeepSeek V4 is the current Chinese champion. The US National Institute of Standards and Technology’s Center for AI Safety and Innovation, CAISI, ran the numbers. Its private testing shows the model underperforms its own maker's claims.
Deepseek says V4 is close to US leaders like Opus 4.6 and GPT-5.4. CAISI found it's closer to the older GPT-5.
It especially lags in abstract reasoning, cybersecurity, and software development. Math is the only bright spot, where it nearly matches the top tier.
CAISI tested performance across cybersecurity, software development, math, natural sciences, and abstract reasoning. CAISI calls Deepseek V4 the most capable Chinese AI model to date. But in private testing, it reportedly performs worse than Deepseek's own technical report suggests.
Deepseek pitches the model as roughly on par with current US models like Opus 4.6 and GPT-5.4. CAISI says it's actually closer to the older GPT-5 - especially on abstract reasoning, cybersecurity, and software development. Math is the one area where Deepseek V4 nearly matches the top US models.
The center, which likely has its own political agenda, sits within the National Institute of Standards and Technology (NIST). Its report paints a picture of a widening gap between US and Chinese models. Independent measurements tell a different story, showing the gap has stayed roughly constant.
Independent measurements disagree with CAISI's core conclusion. They show the performance gap has held steady, not widened. So you have a US government body inside NIST framing the race as one America is winning by a larger margin. And you have other data suggesting a persistent, stable rivalry.
This tells us more about benchmarks than about models. A test administered by one geopolitical actor will find what that actor needs to find. The math scores prove Chinese models can compete.
The reasoning scores show where they falter. The stalemate continues, measured differently depending on who owns the ruler.
Related Reading
Research & Benchmarks Google's FACTS benchmark shows 70% factuality ceiling across four tests
Research & Benchmarks Databricks finds multi-step agents beat single-turn RAG by 21% to 38% on STaRK
Research & Benchmarks Nvidia's DLSS 4.5 beta adds 6x Multi Frame Generation for RTX 50 GPUs
From Archives Google DeepMind AI co‑clinician beats GPT‑5.4 in blind tests, lags docs
From Archives Anthropic benchmark says Claude matches experts, 23 tasks remain ambiguous
Further Reading
- Stanford: China 'effectively' closes AI model performance gap to US — Silicon Republic
- The U.S.-China AI Model Performance Gap Has Effectively Closed — Rich Turrin Substack
- US-China AI Technology Gap Narrows While Responsible AI Development Continues to Lag Behind — AI.cc
- Chinese AI models have lagged the US frontier by 7 months — Epoch AI
