Archive - SemiAnalysis

Datacenter Anatomy Part 1: Electrical Systems

Meta Datacenter Scrapped, Vertiv, Schneider Electric, Eaton, Datacenter Bill Of Materials By Component, Transformers, Switchgear, Redundancy, UPS, ATS…

Oct 14 •

,

Jeremie Eliahou Ontiveros

, and

Daniel Nishball

AI Neocloud Playbook and Anatomy

H100 Rental Price Cuts, AI Neocloud Giants and Emerging Neoclouds, H100 Cluster Bill of Materials and Cluster Deployment, Day to Day Operations, Cost…

Oct 3 •

and

Daniel Nishball

Clash of the Foundries: Gate All Around + Backside Power at 2nm

Fab Cost, WFE Implications, Backside Power Details

Oct 1 •

and

September 2024

Multi-Datacenter Training: OpenAI's Ambitious Plan To Beat Google's Infrastructure

Gigawatt Clusters, Telecom Networking, Long Haul Fiber, Hierarchical & Asynchronous SGD, Distributed Infrastructure WinnersGigawatt Clusters, Telecom…

Sep 4 •

,

Daniel Nishball

, and

Jeremie Eliahou Ontiveros

The Memory Wall: Past, Present, and Future of DRAM

Winners & Losers in the 3D DRAM Revolution

Sep 3 •

,

,

,

, and

August 2024

Nvidia's Blackwell Reworked - Shipment Delays & GB200A Reworked Platforms

MGX GB200A NVL36, B102, B20, CoWoS-L, CoWoS-S, GB200A NVL64, ConnectX-8, Liquid Cooling vs Air Cooling, NVLink Backplane, PCB, CCL, Substrate, BMC…

Aug 4 •

,

,

Daniel Nishball

,

, and

July 2024

GB200 Hardware Architecture - Component Supply Chain & BOM

Hyperscale customization, NVLink Backplane, NVL36, NVL72, NVL576, PCIe Retimers, Switches, Optics, DSP, PCB, InfiniBand/Ethernet, Substrate, CCL, CDU…

Jul 17 •

,

,

,

,

Jeremie Eliahou Ontiveros

, and

Daniel Nishball

June 2024

100,000 H100 Clusters: Power, Network Topology, Ethernet vs InfiniBand, Reliability, Failures, Checkpointing

Frontier Model Scaling Challenges and Requirements, Fault Recovery through Memory Reconstruction, Rack Layouts

Jun 17 •

and

Daniel Nishball

OpenAI Chip Team Is Now Serious

Poaching Aggressively

Jun 3 •

May 2024

How Dell Is Beating Supermicro

Enterprises, Sovereign AI, CoreWeave, Tesla, AI Neocloud economics + orders

May 30 •

,

Daniel Nishball

, and

Apple’s AI Strategy: Apple Datacenters, On-device, Cloud, And More

When to run on-device, in Apple datacenters, or in the cloud with OpenAI, Deal economics

May 27 •

and

OpenAI Is Doomed? - Et tu, Microsoft?

Meta, Google, Anthropic, DeepSeek, Inflection Phi Wizard, Distribution/Integration vs Capital/Compute?

May 7 •

and

Daniel Nishball

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts