@timbray @evan @timbray @evan yes, and if only one person was using LLMs for 30 minutes here and there, the usage wouldn’t be a problem. But that’s not the scale, it’s tens of millions 24x7.
And even if no one used them, the datacenters consume that power and water constantly. The servers don’t sleep sans queries. They are always running. They require massive amounts of energy and water simply to exist.