Search papers, labs, and topics across Lattice.
This paper performs a replica-based fairness audit of a deployed Early Warning System (EWS) at Centennial College, reconstructing the model and pipeline using institutional data and design specifications. The audit reveals that younger, male, and international students are disproportionately flagged for support, while older and female students with similar dropout risk are under-identified. Furthermore, post-processing exacerbates these disparities by collapsing probabilities into risk tiers.
Deployed risk models can systematically misallocate resources, flagging young, male, and international students for support even when they succeed, while overlooking at-risk older and female students.
Fairness audits of institutional risk models are critical for understanding how deployed machine learning pipelines allocate resources. Drawing on multi-year collaboration with Centennial College, where our prior ethnographic work introduced the ASP-HEI Cycle, we present a replica-based audit of a deployed Early Warning System (EWS), replicating its model using institutional training data and design specifications. We evaluate disparities by gender, age, and residency status across the full pipeline (training data, model predictions, and post-processing) using standard fairness metrics. Our audit reveals systematic misallocation: younger, male, and international students are disproportionately flagged for support, even when many ultimately succeed, while older and female students with comparable dropout risk are under-identified. Post-processing amplifies these disparities by collapsing heterogeneous probabilities into percentile-based risk tiers. This work provides a replicable methodology for auditing institutional ML systems and shows how disparities emerge and compound across stages, highlighting the importance of evaluating construct validity alongside statistical fairness. It contributes one empirical thread to a broader program investigating algorithms, student data, and power in higher education.