A Human in the Loop is Not Enough: The Need for Human-Subject Experiments in Facial Recognition


Workshop paper


Forough Poursabzi-Sangdeh, Samira Samadi, Jennifer Wortman Vaughan, Hanna Wallach

Cite

Cite

APA   Click to copy
Poursabzi-Sangdeh, F., Samadi, S., Vaughan, J. W., & Wallach, H. A Human in the Loop is Not Enough: The Need for Human-Subject Experiments in Facial Recognition.


Chicago/Turabian   Click to copy
Poursabzi-Sangdeh, Forough, Samira Samadi, Jennifer Wortman Vaughan, and Hanna Wallach. A Human in the Loop Is Not Enough: The Need for Human-Subject Experiments in Facial Recognition, n.d.


MLA   Click to copy
Poursabzi-Sangdeh, Forough, et al. A Human in the Loop Is Not Enough: The Need for Human-Subject Experiments in Facial Recognition.


BibTeX   Click to copy

@techreport{forough-a,
  title = {A Human in the Loop is Not Enough: The Need for Human-Subject Experiments in Facial Recognition},
  author = {Poursabzi-Sangdeh, Forough and Samadi, Samira and Vaughan, Jennifer Wortman and Wallach, Hanna}
}

Abstract
The deployment of facial recognition technologies in high-stakes scenarios has sparked widespread concerns about privacy, reliability, and fairness. A common response to these concerns is the suggestion of adding a human in the loop to provide oversight and ensure fairness and accountability. However, the effectiveness of this approach is not often studied empirically, and the literature shows that humans have biases of their own. In this position paper, we argue for the necessity of empirical studies on human-in-the-loop facial recognition systems. We outline several technical and ethical challenges that arise in conducting such controlled studies and interpreting their results conclusively. Our goal is to initiate a discussion about the best path forward for AI and HCI researchers to work together towards empirical and human-centered approaches to the design and evaluation of human-in-the-loop facial recognition systems.

PDF

Share



Follow this website


You need to create an Owlstown account to follow this website.


Sign up

Already an Owlstown member?

Log in