Researchers from the University of California reckon the growth in popularity of AI might not be without a significant environmental impact. The Associated Press (AP) reported on a preliminary study from the University, which indicates as few as five ChatGPT queries can result in gulping up 500 milliliters of water (roughly a 16-ounce bottle) at Microsoft’s Iowa data center. The study also includes indirect water use from other sources associated with the data center, like the power plant that feeds its energy.
Previously, we have looked with concern at the electricity consumption of hyperscalers like Google, Microsoft, and AWS. We also saw cryptocurrency mining operations push computing energy consumption figures to new highs a few years ago. Water is arguably a more precious resource, but California researchers have had to put unexpected efforts into digging up water consumption figures, with AP characterizing server companies as “secretive” regarding specifics.
The goal of the UC researchers was to uncover the environmental impact of AI processing, spurred by the success of products like ChatGPT. This is based on the knowledge that Microsoft’s Iowa data centers are a major driver behind a great deal of the recent AI processing expansion.
Image 1 of 2
One of Microsoft’s most powerful computers known to be dedicated to OpenAI is situated in Iowa. The system, which was first unveiled in 2020, is powered by more than 285,000 AMD InfiniBand CPU cores and 10,000 GPUs. It is dedicated to GPT-4, OpenAI’s fourth-generation model.
Figures show that from 2021-22, Microsoft’s water consumption in Iowa rose 34% to nearly 1.7 billion gallons. The UC researchers peg this increase as due to the rise of AI. Calculations indicate that the data center uses half a liter of water (16 fluid oz) per 5 to 50 ChatGPT queries. Variables affecting water consumption (5 to 50 is a wide range) include server location and weather (some server cooling methods consume water). Interestingly, there is no mention of any correlation between query complexity and water or electricity consumption.
However, the above estimates include “indirect water usage,” not tallied by the companies involved — like water usage from the power plants that feed electricity to the data centers.
AP got a statement from Microsoft, which sought to highlight its progress in efficiency, the use of renewables, and other efforts made in the name of sustainability. Separately, OpenAI admitted to AP that “training large models can be energy and water-intensive” but said it was striving for greater training efficiency.
Things could be worse, according to the researchers. They say that the data center’s location in Iowa means that for much of the year, the weather is cool enough that air venting from the building is sufficient for server cooling. The facility only starts to draw water from the mains when the weather hits 29.3 degrees Celsius (about 85 degrees Fahrenheit) or above,
Figures for July 2022 show the water draw is still considerable during the summer period, with Microsoft’s Iowa data centers pumping in about 11.5 million gallons of water, according to the West Des Moines Water Works (about 6% of all water consumed in the district). A letter seen by AP indicates the water company and city government are concerned about Microsoft’s peak summer usage. Without improved technology to ensure their peak water usage will be significantly lower, it won’t green-light further data centers.
What about Google and its chat-based Bard AI tool and other AI projects? The researchers say the search giant used 30% more water in the same period (2021-22) across all its US data centers. This rise is again largely attributed by the UC researchers to the explosion in the demand for AI processing. Interestingly, Google’s water consumption in Oregon has been under scrutiny by regulators in recent years and didn’t rise much, but its data centers near Las Vegas doubled their water consumption, and Google’s Iowa facilities were the thirstiest of all.