Liquid cooling data center basics: direct-to-chip, rear door and immersion

Liquid cooling data center designs are spreading because chips now produce more heat than air can easily carry away. Here is a plain look at the three main approaches and what they can and cannot do.

Why air is running out of room

Trade coverage notes that rack power has climbed from 5 to 10 kW in older designs to 30 kW, 50 kW or more today, which is where air cooling starts to struggle. Water and other fluids carry far more heat than air, so they are used closer to the chip.

Direct-to-chip

Cold plates sit on the processors and graphics chips and carry heat away in a liquid loop. Depending on the design, they can remove roughly 70 to 90 percent of a rack’s heat at the source. Fans are still needed for power supplies and networking.

Rear door and immersion

Rear door heat exchangers put a cooling coil on the back of the rack and still rely on server fans. Immersion places servers in a special fluid. It needs specialized hardware, different maintenance routines and usually a higher upfront cost.

The efficiency claim and its limit

Google says water cooled data centers use about 10 percent less energy than many air cooled ones. That is a company claim. Liquid cooling also still has to reject heat somewhere, through dry coolers, chillers or towers, so it does not remove water use on its own.

What this means when you plan a facility

Match the cooling to the chip. Dense AI racks lean toward liquid, while lighter loads can stay on air for years. Plan the pipes, the floor loading and the heat rejection early, because retrofits cost more than getting it right at the design stage.

Ask vendors for measured results from a working site, not only for lab or brochure numbers.

What to watch

The big question is how fast operators retrofit older sites. Rack densities differ by site, so check the operator’s own numbers before drawing conclusions.

Every figure in this article comes from the sources listed below, and where a number is company reported we say so. Our Eco Tools page has calculators for water, PUE, carbon and efficiency payback if you want to test the ideas yourself. If you spot a mistake, tell us and we will fix it.

Sources: Data Center Knowledge on liquid cooling options; Google on climate conscious cooling. Figures marked as company reported come from the company itself.