Insights
As modern servers become more powerful and AI workloads move into the data centre, power, cooling and rack capacity are becoming critical infrastructure considerations. Before investing in new infrastructure, IT managers need to understand whether their server room is ready for the next generation of compute.
Modern server infrastructure is evolving rapidly, driven by higher core counts, increased memory capacities, GPU acceleration and AI-ready workloads. While these advances deliver significant performance gains, they also place greater demands on power, cooling and rack infrastructure than many existing server rooms were originally designed to support.
Understanding these infrastructure requirements before investing in new hardware helps organisations avoid costly upgrades, deployment delays and business disruption. This article explores how server power requirements have changed and what IT leaders should consider when planning for future growth.
Book a Power AssessmentModern servers consume significantly more power
GPU workloads increase rack power density
UPS and cooling must scale together
Standard 10A circuits have practical limits
Assess infrastructure before every server refresh
For many organisations, server room power planning has not changed much over the past decade. A new server was ordered, connected to available power, and added to the rack. In most cases there was plenty of capacity available.
That assumption is rapidly becoming outdated.
Modern servers are significantly more powerful than their predecessors, supporting larger CPU counts, higher memory capacities, increased storage density, and increasingly, GPU acceleration for AI, analytics, visualisation, and high-performance computing workloads.
As organisations explore AI, machine learning, VDI, data analytics, and other compute-intensive applications, power consumption is becoming one of the most overlooked constraints in infrastructure planning.
Before investing in new infrastructure, IT managers should understand how server power requirements have changed and what this means for their server rooms, racks, UPS systems, and cooling infrastructure.
A rack containing ten servers of this type would typically consume between 4kW and 6kW. Add some switches and supporting devices, and most server rooms could comfortably support these environments using standard 10A power circuits and modest UPS and PDU infrastructure.
Five years ago, a typical virtualisation host might have looked something like this:
A typical virtualisation server from a few years ago, commonly used for VMware or Hyper-V environments with external storage.
2 × Intel Xeon Silver processors
256–512GB RAM
2 × SSD drives for OS
Multiple 1GB or 10GB Networking
Dual power supplies
VMware or Hyper-V
External storage assumed
Idle: 180-250W
Average production load: 350-500W
Peak load: 600-700W
Today's virtualisation environments often consolidate significantly more workloads onto fewer hosts.
A typical virtualisation server from a few years ago, commonly used for VMware or Hyper-V environments with external storage.
2 × Intel Xeon 6 processors
768 GB to 1.5 TB RAM
NVMe storage
25GbE networking
Hypervisor platform (VMware, Nutanix, Hyper-V, Proxmox)
Idle: 300–450W
Average production load: 600–900W
Peak load: 1,200W+
While these systems deliver dramatically higher performance, they can consume nearly double the power of similar systems deployed only a few years ago.
In many environments, a single GPU server remains manageable, but it still changes the planning conversation for power, cooling and UPS capacity.
Dual Xeon/AMD processors
1 TB RAM
2 × NVIDIA L40S GPUs
Base server: 700-900W
2 × L40S GPUs: approximately 700W
Estimated peak power: 1.4kW to 1.8kW
In many environments this remains manageable.
In many environments, a single GPU server remains manageable, but it still changes the planning conversation for power, cooling and UPS capacity.
Dual Xeon/AMD processors
1 TB RAM
2 × NVIDIA L40S GPUs
Base server: 700-900W
2 × L40S GPUs: approximately 700W
Estimated peak power: 1.4kW to 1.8kW
A single server can now consume as much power as three or four traditional virtualisation hosts from only a few years ago.