Why Enterprise AI Isn't Delivering ROI | Ahmed Bashir, DevRev
Artikelbild eller återanvändbart omslag för Eye on AI
The pattern is familiar to every enterprise leader: the AI demo works perfectly, the enterprise deployment disappoints, and the CIO can't explain why.
Ahmed Bashir, Chief Technology Officer of DevRev, joins Craig Smith with a specific and well-supported answer: the problem isn't the model. It's that enterprise data is organizationally complex, fragmented across dozens of tools, locked behind conditional permissions, organized by custom schemas, and every prominent AI benchmark tests models against flat files with pre-packaged data, which has nothing to do with how enterprise data actually lives. DevRev's Enterprise Bench is the first benchmark to test complete agent harnesses against a realistically distributed enterprise environment where the agent must find, relate, and validate information before performing any task, and the results expose a gap that pre-packaged benchmarks hide entirely. The most striking finding: DevRev's system achieves 50% higher accuracy than Claude Code using the identical Opus family model. The entire delta comes from the shared memory layer, the governance, semantic understanding, and orchestration that sits between the model and the enterprise data.
Texten är källans egen beskrivning av publiceringen. Innehållet tillhör Eye on AI.
Mer att läsa
Experts say AI has made planning cyberattacks on industrial equipment faster by helping attackers read manuals and research past accidents more quickly
Techmeme för 1 tim sedan
Current and former officials from the US and other countries describe the Chinese spy agency MSS' campaign to help Chinese companies acquire advanced AI chips
Techmeme för 5 tim sedan
Tesla rolls out FSD v15, featuring a photorealistic rendering of car surroundings; Elon Musk says it is real-time AI video generation without using game engines
Techmeme för 6 tim sedan
Sources: AI server suppliers like Dell, HPE, Lenovo, and Supermicro are demanding substantially higher prices from buyers, months after contracts were signed
Techmeme för 6 tim sedan
