The Energy Footprint of Humans and Large Language Models
Each time someone interacts with a large language model (LLM), there is an energy cost in running the model for inference. In addition, there is an energy cost in the preparation and training of the model before it was brought to production. It is relatively easy to look at these costs in terms of kilowatt-hours […]