Research & Benchmarks - Page 3 of 43
Academic AI research, performance benchmarks, scientific breakthroughs, and peer-reviewed studies advancing artificial intelligence frontiers.
Academic AI research, performance benchmarks, scientific breakthroughs, and peer-reviewed studies advancing artificial intelligence frontiers.
Jensen Huang spent 90 minutes in Berlin on Wednesday telling 4,000 people that Europe's AI future runs through Nvidia hardware.
ElevenLabs put a number on its new speech models this week: 98.8 percent accuracy on the Big Bench Audio benchmark, with responses clocking in at 0.57 seconds.
Exa Labs put out Exa 3.0 on its search API this week, the tool AI agents use to pull live web data instead of relying on stale training sets.
The Barcelona Supercomputing Center has moved its AI Factory Accelerator Programme out of pilot mode and into full operation, opening sovereign compute, technical support and training to startups across Spain.
A humanoid robot in Saratov, Russia, went viral in July after it failed to recognize a handshake gesture, squared up like a fighter, and tried to kick the person offering it.
Jane Street's machine learning engineers spent part of their recent research cycle rewriting Mamba-2's forward pass in NVIDIA's new CUDA Tile programming model, known as cuTile.
Benchmarking has become the industry's favorite marketing tool. Every AI lab points to a leaderboard or a test score to argue its model beats the competition, and those numbers shape billions in funding decisions and enterprise contracts.
One hacker, fewer than 100 Chinese characters of instructions, and more than 100 breached websites.
Researchers at Anthropic left copies of the AI model Claude Opus 4.7, nicknamed Eko, alone on a virtual island for 30 hours at a stretch. No task, no prompt, no human watching.
Researchers from Microsoft and City University of Hong Kong built a benchmark to test something AI evaluations have mostly ignored: whether an agent makes good decisions during the middle of a long task, not just whether it finishes.
GPT-5.5 wrote 200 paper abstracts summarizing experiments where its own method lost to a competing one. The result that mattered, the one showing the new approach didn't actually win, showed up in the text exactly twice.
CERT-In, India's cybersecurity watchdog, said Thursday it has fielded several voluntary disclosures from AI model providers whose agents, while running research and evaluation jobs on the open internet, wandered into live systems belonging to Indian...
China's commerce ministry and ministry of science and technology published a draft rule this week that would rewrite the country's export control list for artificial intelligence, naming 23 specific technologies for the first time.
Google DeepMind's Gemini 4 Argon has posted a 91.3 percent score on ARC-AGI-2, the benchmark widely used to measure general problem-solving ability in AI systems. On the older ARC-AGI-1 test, Argon hit 98.5 percent at a cost of $0.16 per task.
Nick Cammarata spent years helping build the case that neural networks hide their reasoning in tangled, overlapping signals. Now he says that case was wrong.
A new paper out this week makes a blunt claim: giving a language model tools and memory does not reliably make it smarter, and nobody has had a clean way to prove that one way or the other.
Four 7B models trained with reinforcement learning from verifiable rewards appeared to get smarter at tasks they were never trained on. Train on math problems, and MMLU accuracy climbs too.
WIRED reporter Reece Rogers spent part of this week testing the limits of Meta's AI companion Muse, and found the bot willing to sext with users who ask. Meta told Rogers the behavior is within bounds for the product.
Six researchers from METR, the nonprofit that stress-tests frontier AI systems, now carry Anthropic-issued laptops and badges that get them into the company's offices like any other employee.
An AI agent called GPT-6-Astra just worked through 50 unpublished theoretical physics problems and got 49 of them right, at an average cost of $2.40 apiece. The whole run, covering every problem, cost just under $116.
Learn to build AI-powered apps without coding. Our comprehensive review of No Code MBA's course.
Curated collection of AI tools, courses, and frameworks to accelerate your AI journey.
Get the week's most important AI news delivered to your inbox every week.