Why can’t datacenter operators stop thinking about atomic power?

A job ad from Microsoft shows it’s looking to harness the power of the atom to fuel its growing datacenter footprint, but it’d hardly be the first.

Redmond is looking for someone who “will be responsible for maturing and implementing a global Small Modular Reactor (SMR) and microreactor energy strategy.”

Microsoft’s interest in SMRs isn’t even the company’s first foray into nuclear power. In May, Redmond signed up to buy power from fusion energy startup Helion beginning in 2028, despite the fact the company has yet to prove its tech works.

And over the past few months, we’ve seen numerous datacenter operators embrace nuclear power as a means to end their reliance on fossil fuels.

Last month, Green Energy Partners and IP3 detailed a plan to build a massive datacenter campus in Virginia powered entirely on small modular reactors (SMRs) — more on those later. Meanwhile, Swedish datacenter operator Bahnhof is also investigating the use of the miniaturized reactors to not only power its operations, but as many as 30,000 households in the surrounding area.

Meanwhile, Cumulus Data opened the doors on a nuclear-powered datacenter in Pennsylvania this January. The 48 megawatt facility is located alongside the 2.45 gigawatt Susquehanna power plant.

DCs thirst for power

What’s behind this recent trend? It’s simple, datacenters are consuming more power than ever before thanks – in part – to the explosive growth of generative AI.

To put things in perspective, today a reasonably large cloud or hyperscale campus might be rated for 50 megawatts of capacity. However, anyone who’s been paying attention to the GPUs and other accelerators that AI workloads run on knows that while they’ve been getting progressively more effective, they’re also using a lot more power.

AMD CEO Lisa Su highlighted this inconvenient truth during a speech at the International Solid-State Circuits Conference earlier this year. The problem, she explained, is that while the performance of CPUs and GPUs has roughly doubled every 2.4 years, power efficiency hasn’t kept up.

Su estimated that a zettaflop-class supercomputer — one 1,000x faster than the US’s chart-topping Frontier system — was only about a decade away, but would require somewhere in the neighborhood of 500 megawatts of power. “That’s on the scale of what a nuclear power plant would be,” she said at the time.

You might be thinking something along the lines of “yeah, but that’s a supercomputer,” but the fact is the AI clusters used to train large language models like OpenAI’s GPT-4 are constructed from many of the same building blocks.

In fact, many modern AI clusters deployed by the likes of Microsoft, Google, and Meta would theoretically place among the 10 most powerful systems on the Top500 ranking of supercomputers.

The rise of the microgrid

The amount of power those facilities draw means datacenter operators know they can’t always tap the juice they need from the grid.

In locations like Northern Virginia or Dublin, Ireland, where many datacenters congregate, power is often cheap but also in incredibly high demand. During peak operating hours, it’s not uncommon for datacenters in these markets to supplement grid power using backup generators.

Some datacenter operators have gone so far as to build their own power plants — sometimes called “microgrids” — to deal with this instability in electrical supply. For example, back in July, Microsoft got the green light to build a 170 megawatt natural gas generator to keep the lights on at its €900 million datacenter development outside Dublin. The plant, which consists of 22 individual generators and reportedly cost €100 million to build, is designed to operate during periods in which the national grid can’t keep up.

Microsoft isn’t alone. Amazon plans to employ natural gas fuel cells at some of its Oregon datacenters, after reportedly running into trouble securing adequate grid capacity to feed its needs.

While both examples address the cloud provider’s power supply challenges, they still rely on fossil fuels. It’s hard to say you’re serious about cutting your carbon footprint while continuing to run your datacenters on decomposed dinosaurs.

And this is where SMRs start to make sense. They emit little or no CO2 during normal operations and are capable of generating a considerable amount of power for a relatively small footprint.

Continue reading the article here, in The Register: