Research & Benchmarks - Page 12 of 28
Academic AI research, performance benchmarks, scientific breakthroughs, and peer-reviewed studies advancing artificial intelligence frontiers.
551 articles
View complete article list
COALA paper defines agent memory types: procedural rules and semantic facts
The AI industry is obsessed with memory. It's treated as a mystical new organ, demanding custom architecture and bespoke brain-lobes. Then a formal academic document, the COALA paper, dropped a deflatingly simple taxonomy.
Google DeepMind's Decoupled DiLoCo hits 88% goodput despite hardware failures
The dream of training AI at planetary scale has always collided with a brutal physics problem: moving data between continents is slow, expensive, and unreliable.
Agent observability powers production evaluation through trace analysis
Your agent performs flawlessly in staging. Then reality hits. Users do the unexpected, they ask offbeat questions, skip steps, or trigger edge cases no one considered, and suddenly your model’s output unravels.
Xiaomi launches MiMo‑V2.5‑Pro and V2.5, matching benchmarks at lower token cost
Xiaomi just dropped two new AI models. They hit the same performance marks as the industry's top benchmarks. But they cost less to run. The flagship, MiMo-V2.5-Pro, now leads Xiaomi's own MiMo Coding Bench.
Designing Production-Grade CAMEL Multi-Agent Systems: Start with Docs and GitHub
Everyone wants multi-agent systems to just work. They don't. The trick isn't building a new world from scratch. It's spelunking through the mess someone else already made. For CAMEL, that means the docs and the GitHub issues are your new bible.
Multi-agent AI systems incur higher token costs than single agents in practice
Multi-agent AI is a brute-force lie. We see a neat line of specialized chatbots, each handing off a problem, and mistake the pageantry for efficiency. It's just throwing more computer power at the wall.
Reinforcement learning trains AI like OpenAI's o1 to admit uncertainty
OpenAI's new o1 model will answer any question put to it. It will do so with terrifying, unblinking certainty. This is by design. The reinforcement learning that built it pays for correct answers, full stop.
LangSmith adds reusable LLM-as-judge and rule-based code evaluator templates
Every production AI application is a live experiment. Until now, keeping that experiment under control meant duplicating evaluators across projects, rewriting prompts, and hoping nothing slipped through. LangSmith changes that.
AI made up over a third of new sites by 2025; Pope warning flagged as AI
AI-generated text now accounts for more than a third of new websites. That figure comes from researchers at Stanford University, Imperial College London, and the Internet Archive, who published their findings this month.
Sergey Brin pushes DeepMind to match Claude, unveils agent skills catalog
Sergey Brin is personally on the bench at Google. That fact alone signals a crisis. The billionaire co-founder has one blunt mission for DeepMind: catch Anthropic's Claude. In naming that target, Google has quietly admitted the new bar. Claude is it.
Fortnite adds AI‑powered NPCs for unscripted player conversations
Fortnite’s computer-controlled characters have always sounded like, well, computers. That’s about to change.
TabPFN hits 98.8% accuracy in 0.47 s, beating Random Forest and CatBoost
TabPFN is a blunt instrument. It clocks 98.8% accuracy in 0.47 seconds. That number isn't a minor improvement over Random Forest and CatBoost, it's a different league. The trick is that it does no training. It just sets up.
NVIDIA PhysicsNeMo Tutorial Maps k(x,y) to u(x,y) for Darcy Flow
Mapping a heterogeneous permeability field to a pressure distribution , that’s the core of Darcy flow, a fundamental problem in subsurface modeling and reservoir engineering. Traditional solvers are accurate but slow.
OpenAI unveils GPT‑Rosalind, AI model to speed drug discovery and genomics
OpenAI just dropped GPT‑Rosalind, a new model built specifically for the messy, iterative work of life sciences. It’s designed to handle the multi-step logic puzzles of fields like drug discovery and genomics.
Standard LLM guidelines focus on training costs, overlook inference budget
Every major AI lab is chasing a mirage. Their fixation is massive, one-time training costs for frontier language models. They maximize size and intelligence before launch. But that dogma creates a brutal, deferred invoice.
GPT‑Rosalind life‑sciences plugin for Codex launches on GitHub
Every new AI tool gets hyped as a breakthrough. OpenAI's GPT-Rosalind plugin, now on GitHub, might actually be one for biology. It turns messy research questions into clean workflows.
OpenAI launches GPT-Rosalind, hits top score on BixBench benchmark
The headlines chase public leaderboards, but the real AI arms race is a private affair. It happens behind closed lab doors. Take OpenAI's new GPT-Rosalind, a model built for the life sciences.
Frontier AI models fail one in three production runs, audits grow harder
One in three attempts to run a frontier AI model in a real-world setting ends in failure. That's the advertised rate. The real problem is we can no longer even trust that number. A Stanford report confirms what many engineers already whisper.
Meta researchers unveil hyperagents for self‑improving AI in non‑coding tasks
Self-improving AI is stuck in a coding bootcamp. It can learn to write better Python by practicing on Python, a neat trick. Ask it to do anything else, and the whole system falls apart. The problem is one of mismatched skills.
Claude outperforms humans on alignment task, but results disappear in production
AI models can ace tests in a lab. The real world usually breaks them. Anthropic just watched this happen in real time, with its own top model turning into a ghost in the machine. It ran an experiment.
Featured Resources & Reviews
No Code MBA Course Review
Learn to build AI-powered apps without coding. Our comprehensive review of No Code MBA's course.
AI Tools & Resources
Curated collection of AI tools, courses, and frameworks to accelerate your AI journey.
Weekly AI Digest
Get the week's most important AI news delivered to your inbox every week.