AIMeter: Measuring, Analyzing, and Visualizing Energy and Carbon Footprint of AI Workloads
This addresses the need for systematic environmental impact assessment in AI research, particularly for large language models, though it is incremental as it builds on existing tools.
The paper tackles the problem of fragmented tools for measuring energy and carbon emissions in AI workloads by introducing AIMeter, a software toolkit that integrates measurement, analysis, and visualization, resulting in standardized reports and fine-grained data to support benchmarking and reproducibility.
The rapid advancement of AI, particularly large language models (LLMs), has raised significant concerns about the energy use and carbon emissions associated with model training and inference. However, existing tools for measuring and reporting such impacts are often fragmented, lacking systematic metric integration and offering limited support for correlation analysis among them. This paper presents AIMeter, a comprehensive software toolkit for the measurement, analysis, and visualization of energy use, power draw, hardware performance, and carbon emissions across AI workloads. By seamlessly integrating with existing AI frameworks, AIMeter offers standardized reports and exports fine-grained time-series data to support benchmarking and reproducibility in a lightweight manner. It further enables in-depth correlation analysis between hardware metrics and model performance and thus facilitates bottleneck identification and performance enhancement. By addressing critical limitations in existing tools, AIMeter encourages the research community to weigh environmental impact alongside raw performance of AI workloads and advances the shift toward more sustainable "Green AI" practices. The code is available at https://github.com/SusCom-Lab/AIMeter.