Search papers, labs, and topics across Lattice.
This paper introduces Ichnos+, a system designed to estimate the carbon footprint of scientific workflows, specifically targeting Nextflow environments. By leveraging node-specific power models and carbon intensity data, Ichnos+ achieves a remarkable estimation accuracy with only a 10.8% error compared to hardware-level measurements, outperforming existing tools like the nf-core co2footprint plugin. Additionally, Ichnos+ not only estimates operational carbon emissions but also incorporates embodied emissions, water, and land use, showcasing its versatility across different workflow systems such as Apache Airflow.
Ichnos+ achieves a groundbreaking 10.8% estimation error in carbon footprint calculations, outperforming existing methodologies and expanding the scope of environmental impact assessments in scientific workflows.
As data-intensive scientific workflows scale to facilitate the automation of analysis of increasing amounts of data, their resource-intensive and long-running execution incurs significant energy consumption and carbon emissions. Given the already significant and rising emissions from the ICT sector, it is crucial to quantify and understand the carbon footprint of scientific workflows. However, existing tooling is commonly not usable in shared, virtualized environments or resorts to power models that are based on only one or two generic data points. To address this gap, this paper presents Ichnos+, a novel system to quantify the environmental footprint of Nextflow scientific workflows. Ichnos+ enables post-hoc footprint estimation based on existing workflow traces, node-specific power models for the computational resources utilized, and carbon intensity data aligned with the execution time. We evaluate Ichnos+ against hardware-level energy measurements obtained using Intel RAPL, and the nf-core co2footprint plugin, which implements the Green Algorithms methodology. We find that Ichnos+ is capable of estimating workflow energy consumption with an estimation error of 10.8% across three compute clusters, significantly outperforming the nf-core plugin. We further show that Ichnos+ extends beyond operational carbon to estimate embodied emissions as well as water and land use. Finally, we demonstrate how Ichnos+ can be extended for another workflow system, Apache Airflow, maintaining a similarly high degree of estimation accuracy.
