How much energy does it take to run an AI model?

This blows my mind. I double-checked the math and think it’s accurate. The average power needed to generate one image from text is equivalent to an entire cell phone battery. A new paper published by researchers from Hugging Face and Carnegie Mellon University used a plugin called CodeCarbon to measure power usage while running queries against a variety of models. Text classification was the lowest usage, while image generation was the highest by far. learn more and original paper