Many diverse factors can cause software bias, including poor design, implementation bugs, unintended component interactions, and the use of unsafe algorithms or biased data. Our work focuses on using the engineering process to improve software fairness. For example, tools can help domain experts specify fairness properties and detect inconsistencies among those requirements; they can automatically generate test suites to measure software bias to identify bias in black-box systems even when the system’s source code and the data used to train it are unavailable; they can help developers and data scientists debug causes of bias, both in the source code and the data; and they can formally verify fairness properties in the implementation. Our work in engineering fair systems combines research in software engineering with machine learning, vision, natural language processing, and theoretical computer science to create tools that help build more fair systems.
Publications
- Yuriy Brun and Alexandra Meliou, Software Fairness, in Proceedings of the New Ideas and Emerging Results Track at the 26th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE), 2018, pp. 754-759.
- Rico Angell, Brittany Johnson, Yuriy Brun, and Alexandra Meliou, Themis: Automatically Testing Software for Discrimination, in Proceedings of the Demonstrations Track at the 26th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE), 2018, pp. 871-875.
- Sainyam Galhotra, Yuriy Brun, and Alexandra Meliou, Fairness Testing: Testing Software for Discrimination, in Proceedings of the 11th Joint Meeting of the European Software Engineering Conference and ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE), 2017, pp. 498-510.
Winner of an ACM SIGSOFT Distinguished Paper Award - Rico Angell, Brittany Johnson, Sainyam Galhotra, Yuriy Brun, and Alexandra Meliou, Themis: Automated Test Suite Generator for Testing Software for Fairness
- Testing Software for Discrimination video