From Human Intervention to Human Involvement: A Critical Examination of the Role of Humans in (Semi-)Automated Administrative Decision-Making

In view of recent scandals, evolving regulatory demands, and changing perceptions of human involvement in automated systems, this study examines how the role of humans in semi-automated administrative decision-making (AADM) is conceptualized in academic literature. We conducted a qualitative systematic literature review from the public administration, law and socio-technological fields, to critically examine what is understood as human involvement in AADM.

Our findings suggest that the literature largely focuses on human intervention in AADM, where individual decision makers either review automated outputs before making a decision (human-in-the-loop) or review automated decisions (human-out-of-the-loop). However, a broader scope on human involvement in AADM – which also includes system designers (human-in-control) and monitoring and supervisory roles responsible for ongoing oversight (human-on-the-loop) is crucial to fully capture the human-machine dynamic in AADM.

These insights can be used to advance the understanding of the human-automation interaction in AADM through a more comprehensive conceptualization of human involvement. This broader, governance-oriented, view has the potential to optimize the interrelationship between human involvement and automation, ultimately improving accountability, effectiveness, and adaptability in AADM. New legislation underscores the importance of meaningful human involvement beyond isolated review points, encompassing design and ongoing oversight.