Today in AI
Friday, June 12, 2026
Today in AI: Blackwell's 35x Token Cost Cut, Inference-Optimized Chips Racing, Data Center Power Wall — June 12, 2026
5
links
-
1www.businessinsider.comNVIDIA's Blackwell GPU reduces inference cost to $0.12 per million tokens, down 97% from Hopper's $4.20—reshaping the entire inference economics model for deployed services. This shifts viability thresholds for margin-constrained applications and forces repricing across cloud providers within weeks.
-
2www.stocktitan.netIntel is sampling Crescent Island, an inference-focused data-center GPU designed after canceling the broader Falcon Shores effort under CEO Lip-Bu Tan's rebuild. This signals Intel's narrowed bet on inference workloads as a competitive wedge against NVIDIA's dominance in training.
-
3www.trendforce.comCanadian startup Taalas launched the HC1 chip on February 20, 2026, embedding Llama 3.1 8B directly into silicon for 16,960 tokens/s/user throughput—eliminating memory bottlenecks by collapsing the software-hardware boundary. This demonstrates a viable alternative to general-purpose GPU inference for fixed-model deployments.
-
4www.ncnonline.netGartner projects global data center consumption reaching 565 TWh in 2026 (up from 447 TWh in 2025), with power demand rising to 132 GW from 104 GW, driven almost entirely by AI workload growth. Infrastructure builders now face hard power grid ceilings and regulatory scrutiny, forcing site selection and efficiency optimization into deal-critical criteria.
-
5QumulusAI Secures $124M in Blackwell Inference Contracts; Vertically Integrated Model Gains Tractionwww.guardonline.comQumulusAI locked $124M in 3-year customer subscriptions for Nvidia Blackwell-based workloads with Hyperbolic and another inference platform, signaling that vertically integrated AI cloud operators are winning long-term commitments as inference becomes a metered, commoditized service. This validates the shift away from consumer GPU rentals toward SLA-backed inference-as-a-service.