Server Rack

A server rack is a metal shelving unit that holds computer servers stacked in layers. Think of a filing cabinet in an office. It has multiple slots, and instead of folders, each slot holds and secures one server. The key point is that the sizing is standardized, so equipment from any manufacturer can be slotted into the same frame.

As the AI boom has taken off, the servers going into these racks have become much hotter and more power-hungry than before. So the racks themselves are being redesigned into specialized structures that can supply ample electricity and even include cooling plumbing. No matter how many chips get manufactured, if there aren't enough racks, those chips can't actually be installed and run in a data center.

That's why, when people discuss what's holding back the growth of companies like NVIDIA these days, they bring up not just chip manufacturing capacity but also power, racks, and memory prices. Even if chips are abundant, if there aren't enough racks to house them and enough power to feed those racks, the bottleneck ends up forming there instead.

In the article, an analyst asks NVIDIA's CEO which factor is most constraining growth: data center power, server rack (shell) supply, memory prices, or securing foundry wafer capacity. The key point is that a server rack isn't the semiconductor itself, but the physical frame that houses and secures servers and GPUs. The phrase is used to convey that no matter how many chips are available, if there aren't enough racks and the power needed for them, computers can't actually be put into operation.