Rob May and Cooper from NeuroMetric talk with AI researcher Yash Sharma about how models actually generalize and why they behave unpredictably in novel scenarios.
inferencetimetactics.podbean.com
Rob May and Cooper from NeuroMetric talk with AI researcher Yash Sharma about how models actually generalize and why they behave unpredictably in novel scenarios.
inferencetimetactics.podbean.com
State Space Models like Mamba cannot generalize on their own. But when given tools at runtime (search, memory, code execution) they can reason and scale far beyond their training range.
State Space Models like Mamba cannot generalize on their own. But when given tools at runtime (search, memory, code execution) they can reason and scale far beyond their training range.
Rob May, Calvin Cooper, and Byron Galbraith talk with Prashanth Velidandi (@pmv_inferx) about InferX, serverless inference, idle GPUs, and how infra innovation is defining the next era of AI.
Listen: inferencetimetactics.podbean.com
Rob May, Calvin Cooper, and Byron Galbraith talk with Prashanth Velidandi (@pmv_inferx) about InferX, serverless inference, idle GPUs, and how infra innovation is defining the next era of AI.
Listen: inferencetimetactics.podbean.com
In this episode: MIT research, why inference time decisions matter, how to evaluate agents, and where durable value sits in the stack.
In this episode: MIT research, why inference time decisions matter, how to evaluate agents, and where durable value sits in the stack.
This tool makes it simple to test inference time compute strategies across LLMs.
Why it matters:
ITC impacts cost, performance, and accuracy
Experimentation accelerates AI innovation
Intelligence is moving to the systems level
This tool makes it simple to test inference time compute strategies across LLMs.
Why it matters:
ITC impacts cost, performance, and accuracy
Experimentation accelerates AI innovation
Intelligence is moving to the systems level
Rob May, Calvin Cooper, Byron Galbraith, and Dave Rauchwerk share updates on the NeuroMetric Inference Time Compute Studio and why AI is moving from scaling single models to full AI system orchestration.
inferencetimetactics.podbean.com
Rob May, Calvin Cooper, Byron Galbraith, and Dave Rauchwerk share updates on the NeuroMetric Inference Time Compute Studio and why AI is moving from scaling single models to full AI system orchestration.
inferencetimetactics.podbean.com
Listen: inferencetimetactics.podbean.com
Listen: inferencetimetactics.podbean.com
Rob May and Calvin Cooper unpack GPT-5.0’s launch and what OpenAI’s routing layer signals about the shifting AI landscape.
Listen: inferencetimetactics.podbean.com?utm_campaign... @robmay-nyc.bsky.social
Rob May and Calvin Cooper unpack GPT-5.0’s launch and what OpenAI’s routing layer signals about the shifting AI landscape.
Listen: inferencetimetactics.podbean.com?utm_campaign... @robmay-nyc.bsky.social
Next week we’re launching a preview of our AI Evaluation Platform to make deployments reliable and ROI-driven.
Learn more: open.substack.com/pub/neuromet...
Next week we’re launching a preview of our AI Evaluation Platform to make deployments reliable and ROI-driven.
Learn more: open.substack.com/pub/neuromet...
@robmay-nyc.bsky.social, Calvin Cooper, and Byron Galbraith break down Apple’s paper, why reasoning models loop, and what it takes to make them reliable.
Listen: inferencetimetactics.podbean.com?utm_campaign...
@robmay-nyc.bsky.social, Calvin Cooper, and Byron Galbraith break down Apple’s paper, why reasoning models loop, and what it takes to make them reliable.
Listen: inferencetimetactics.podbean.com?utm_campaign...
Listen here: inferencetimetactics.podbean.com
Listen here: inferencetimetactics.podbean.com
Inference Time Tactics is our new podcast on inference-time compute
Listen & subscribe, available on all platforms: InferenceTimeTactics.podbean.com/e/episode-1/
Inference Time Tactics is our new podcast on inference-time compute
Listen & subscribe, available on all platforms: InferenceTimeTactics.podbean.com/e/episode-1/
open.substack.com/pub/neuromet...
open.substack.com/pub/neuromet...
open.substack.com/pub/neuromet...
open.substack.com/pub/neuromet...