This guide covers data center cooling in plain terms. Cooling is where data center design is changing fastest. Traditional rooms were cooled by air moved across racks. As chips get hotter, more of that heat is being pulled out with liquid.
The chilled water backbone for data center cooling
Most large facilities still rely on a chilled water plant. Chillers or cooling towers cool a water loop. Pumps move that water through pipes to the equipment that needs it. Valves, strainers, heat exchangers and controls keep the loop balanced and let maintenance crews isolate sections without a shutdown.
Where liquid cooling comes in
Direct-to-chip systems bring coolant right to the processor using cold plates. A coolant distribution unit, or CDU, sits between the facility water loop and the smaller loop that serves the servers. Immersion systems go further and place servers in a dielectric fluid.
What it means on the job for data center cooling
Pipe sizes, flow rates and water quality all matter more as loads climb. Cleanliness and flushing procedures are strict, because small particles can damage cold plates. Contractors should expect tighter tolerances, more testing and more coordination between mechanical, controls and the equipment vendors.
Looking ahead
Most new AI facilities are expected to combine both approaches: liquid for the hottest chips and air for the rest. The water side of the building is getting bigger, more detailed and more important to the schedule.
Why the choice matters for design for data center cooling
A traditional air-cooled room might handle 5 to 15 kilowatts per rack. Modern AI racks can run far beyond that, and the densest designs are well over 100 kilowatts. Air alone cannot remove that much heat, so designers bring liquid closer to the chip while keeping the chilled water plant as the main heat rejection system.Components to know
Key pieces include chillers or dry coolers, cooling towers where water is available, pumps, heat exchangers, coolant distribution units, manifolds and the valves and controls that balance flow. Each part has to work with the rest, and a failure in one place should not take down the whole system.What contractors should plan for
Expect strict cleanliness and flushing procedures, detailed pressure testing and tight coordination with equipment vendors. Water treatment and filtration protect the cold plates. Planning for maintenance, with isolation valves and bypass paths, keeps the facility running when something needs service. Teams that master these details will be well placed as liquid cooling becomes standard.Related reading on data center cooling
For more, see our guides on what PUE really measures and data center water use. For background from an outside source, visit the ASHRAE.
Get the Eco Business News newsletter. Free.
Plain news on eco, business and data centers. No spam.
Quick recap
- The short version: Listen to this article 1x 1.25x 1.5x (function(){var w=document.currentScript.parentNode;var b=w.querySelector(‘.ebn-lb’),t=w.querySelector(‘.ebn-lt’),s=w.querySelector(‘.ebn-ls’);if(!(‘speechSynthesis’ in window)){w.style.display=’none’;return}var root=w.closest(‘.content-inner’)||document;var q=[],i=0,on=false;function build(){q=[];root.querySelectorAll(‘p,h2’).forEach(function(e){if(e.closest(‘.ebn-listen,.ebn-sub-end’))return;var x=e.textContent.trim();if(x.length>2)q.push(x)});return q}function words(){return build().join(‘ ‘).split(/\s+/).length}t.textContent=Math.max(1,Math.round(words()/160))+’ min listen’;function say(){if(!on||i>=q.length){on=false;b.textContent=’Listen to this article’;b.className=’ebn-lb’;i=0;return}var u=new SpeechSynthesisUtterance(q[i]);u.rate=parseFloat(s.value);u.lang=’en-US’;u.onend=function(){i++;say()};speechSynthesis.speak(u)}b.onclick=function(){if(on){on=false;speechSynthesis.cancel();b.textContent=’Listen to this article’;b.className=’ebn-lb’;return}build();i=0;on=true;b.textContent=’Stop listening’;b.className=’ebn-lb ebn-on’;speechSynthesis.cancel();say()};s.onchange=function(){if(on){speechSynthesis.cancel();say()}};window.addEventListener(‘beforeunload’,function(){speechSynthesis.cancel()})})(); This guide covers data center cooling in plain terms.
- The chilled water backbone for data center cooling: Most large facilities still rely on a chilled water plant.
- Where liquid cooling comes in: Direct-to-chip systems bring coolant right to the processor using cold plates.
- What it means on the job for data center cooling: Pipe sizes, flow rates and water quality all matter more as loads climb.
- Looking ahead: Most new AI facilities are expected to combine both approaches: liquid for the hottest chips and air for the rest.
- Why the choice matters for design for data center cooling: A traditional air-cooled room might handle 5 to 15 kilowatts per rack.
- Components to know: Key pieces include chillers or dry coolers, cooling towers where water is available, pumps, heat exchangers, coolant distribution units, manifolds and the valves and controls that balance flow.
Questions readers ask
What should I know about the short version?
Cooling is where data center design is changing fastest. Traditional rooms were cooled by air moved across racks.
What should I know about the chilled water backbone for data center cooling?
Chillers or cooling towers cool a water loop. Pumps move that water through pipes to the equipment that needs it.
What should I know about where liquid cooling comes in?
A coolant distribution unit, or CDU, sits between the facility water loop and the smaller loop that serves the servers. Immersion systems go further and place servers in a dielectric fluid.
What should I know about what it means on the job for data center cooling?
Cleanliness and flushing procedures are strict, because small particles can damage cold plates. Contractors should expect tighter tolerances, more testing and more coordination between mechanical, controls and the equipment vendors.
What should I know about looking ahead?
The water side of the building is getting bigger, more detailed and more important to the schedule.
What should I know about why the choice matters for design for data center cooling?
Modern AI racks can run far beyond that, and the densest designs are well over 100 kilowatts. Air alone cannot remove that much heat, so designers bring liquid closer to the chip while keeping the chilled water plant as the main heat rejection system.
Test yourself
- In one sentence, how would you explain the short version to a friend? Compare your answer with the section above.
- In one sentence, how would you explain the chilled water backbone for data center cooling to a friend? Compare your answer with the section above.
- In one sentence, how would you explain where liquid cooling comes in to a friend? Compare your answer with the section above.
- In one sentence, how would you explain what it means on the job for data center cooling to a friend? Compare your answer with the section above.
Share this guide
If this guide on data center cooling was useful, send it to a colleague, a neighbor or your team. Use the share buttons at the top of the page to post it on LinkedIn, email it, or copy the link.









