Inside AI's GPU Economy & Infrastructure Boom | Sam Hogan, Kuzco

3 Jan 2025 · 66 min
Episode

3 Jan 2025 · 66 min

0:00

In this podcast Sam Hogan, founder and CEO of Kuzco, explains how the AI compute landscape is shifting from a training‑centric model (≈95% of compute) to an inference‑centric one (projected >90% in a few years) as large language models become production‑ready. He introduces Kuzco as a spot‑market platform that matches sellers of idle GPU cycles—from high‑end consumer cards (e.g., RTX 4090) to data‑center GPUs (H100, L40)—with developers needing LLM inference. The conversation covers GPU supply dynamics, price trends for H100/H200, and why older cards are sufficient for most inference workloads. Technical distinctions between training (high‑bandwidth clustered GPUs, NVLink, pipeline parallelism) and inference (single‑node or modest sharding, latency‑sensitive vs batch jobs) are clarified. Hogan outlines Kuzco’s business model: buying under‑utilized compute at deep discounts, routing requests geographically, and offering 10× lower per‑token costs than centralized providers. Crypto is woven in for cross‑border, low‑fee settlement (stablecoins) and a staking‑based verification layer for compute provenance. He discusses unit‑economics, competitive threats from nation‑state‑backed data‑center farms, and the long‑term vision of LLM tokens becoming a tradable digital commodity with futures markets. The latter part of the episode dives into the emerging AI‑agent ecosystem, hackathon projects (e.g., Eliza framework, crypto‑wallet bots), challenges of autonomy, verification, and bias in training data. Hogan reflects on the broader societal impact: democratization of AI, the compression of startup timelines, and the shift toward physical, social experiences as AI handles more cognitive work.

Chapters

More from Jason

PodcastFigure Co-Founder: How Figure Became A $10B Business | Mike Cagney
Podcast

Figure Co-Founder: How Figure Became A $10B Business | Mike Cagney

5mo ago
PodcastAI Feels Like Crypto In 2017, Circle Raises $222M and Anthropic Cracks Down On SPVs
Podcast

AI Feels Like Crypto In 2017, Circle Raises $222M and Anthropic Cracks Down On SPVs

5mo ago
PodcastHow KelpDAO's $290M Exploit Nearly Killed DeFi | Stani Kulechov & Mike Silagadze
Podcast

How KelpDAO's $290M Exploit Nearly Killed DeFi | Stani Kulechov & Mike Silagadze

5mo ago
PodcastBig Tech Earnings, DeFi United and Pump Fun’s Token Burn
Podcast

Big Tech Earnings, DeFi United and Pump Fun’s Token Burn

5mo ago
PodcastA Quantum Fork is Coming to Bitcoin | Alex Pruden & Philip Martin
Podcast

A Quantum Fork is Coming to Bitcoin | Alex Pruden & Philip Martin

5mo ago
PodcastDeFi’s Latest $290M Hack, Kalshi vs Polymarket & Will the Clarity Act Pass?
Podcast

DeFi’s Latest $290M Hack, Kalshi vs Polymarket & Will the Clarity Act Pass?

5mo ago
PodcastThe Blockworks Vision
Podcast

The Blockworks Vision

5mo ago
PodcastSolana vs Hyperliquid, Why Ethereum Is Overvalued & Crypto In 2026 | Logan Jastremski
Podcast

Solana vs Hyperliquid, Why Ethereum Is Overvalued & Crypto In 2026 | Logan Jastremski

5mo ago
PodcastMarkets Bounce Back, The Hyperliquid Thesis and Kraken Raises $200M
Podcast

Markets Bounce Back, The Hyperliquid Thesis and Kraken Raises $200M

6mo ago
PodcastHow To Make DeFi Great Again | Adrian Vasiljevic & Luca Prosperi
Podcast

How To Make DeFi Great Again | Adrian Vasiljevic & Luca Prosperi

6mo ago
PodcastWhy DeFi Is Unattractive, Claude Mythos and Cryptos's Biggest Winners
Podcast

Why DeFi Is Unattractive, Claude Mythos and Cryptos's Biggest Winners

6mo ago
See all content