Liable, but Not in Control? Ensuring Meaningful Human Agency in Automated Decision-Making Systems

Wagner, Ben ORCID: https://orcid.org/0000-0002-2441-4043 (2019) Liable, but Not in Control? Ensuring Meaningful Human Agency in Automated Decision-Making Systems. Policy and Internet, 11 (1). pp. 104-122. ISSN 1944-2866

[img]
Preview
PDF
Wagner-2019-Policy_&_Internet.pdf
Available under License Creative Commons: Attribution 4.0 International (CC BY 4.0).

Download (492kB)

Abstract

Automated decision making is becoming the norm across large parts of society, which raises interesting liability challenges when human control over technical systems becomes increasingly limited. This article defines "quasi-automation" as inclusion of humans as a basic rubber-stamping mechanism in an otherwise completely automated decision-making system. Three cases of quasi- automation are examined, where human agency in decision making is currently debatable: self- driving cars, border searches based on passenger name records, and content moderation on social media. While there are specific regulatory mechanisms for purely automated decision making, these regulatory mechanisms do not apply if human beings are (rubber-stamping) automated decisions. More broadly, most regulatory mechanisms follow a pattern of binary liability in attempting to regulate human or machine agency, rather than looking to regulate both. This results in regulatory gray areas where the regulatory mechanisms do not apply, harming human rights by preventing meaningful liability for socio-technical decision making. The article concludes by proposing criteria to ensure meaningful agency when humans are included in automated decision-making systems, and relates this to the ongoing debate on enabling human rights in Internet infrastructure.

Item Type: Article
Keywords: automation, function allocation, human rights, Internet architecture, technology policy, artificial intelligence, algorithms
Divisions: Departments > Informationsverarbeitung u Prozessmanag. > Wirtschaftsinformatik und Gesellschaft
Version of the Document: Published
Depositing User: Gertraud Novotny
Date Deposited: 15 Feb 2019 11:17
Last Modified: 14 Feb 2020 13:27
Related URLs:
FIDES Link: https://bach.wu.ac.at/d/research/results/87926/
URI: https://epub.wu.ac.at/id/eprint/6838

Actions

View Item View Item

Downloads

Downloads per month over past year

View more statistics