Buying Tokens vs Building an AI Factory with Sadeepa Wijesekara - #785
Artikelbild eller återanvändbart omslag för TWIML AI
An AI agent can make many model calls to finish a single job.
Some need frontier reasoning. Others can run on an open-weight model, and some involve data that has to stay in-house. How do you decide which inference to buy and which to run yourself? Sadeepa Wijesekara, who leads engineering for HPE Private Cloud AI, joins Sam Charrington to discuss how enterprises make those decisions. They get into what it takes to see the cost of individual calls, how teams route work between hosted and local models, and when running your own GPUs makes economic sense. Sadeepa shares how HPE routes coding requests through a single internal endpoint that can send work to a frontier provider or serve it locally. 🗒️ Full show notes: https://twimlai.com/go/785.
Texten är källans egen beskrivning av publiceringen. Innehållet tillhör TWIML AI.
Mer att läsa
Experts say AI has made planning cyberattacks on industrial equipment faster by helping attackers read manuals and research past accidents more quickly
Techmeme för 1 tim sedan
Current and former officials from the US and other countries describe the Chinese spy agency MSS' campaign to help Chinese companies acquire advanced AI chips
Techmeme för 5 tim sedan
Tesla rolls out FSD v15, featuring a photorealistic rendering of car surroundings; Elon Musk says it is real-time AI video generation without using game engines
Techmeme för 6 tim sedan
Sources: AI server suppliers like Dell, HPE, Lenovo, and Supermicro are demanding substantially higher prices from buyers, months after contracts were signed
Techmeme för 6 tim sedan
