Challenging algorithmic profiling: The limits of data protection and anti-discrimination in responding to emergent discrimination

M. Mann, T. Matzner, Big Data & Society 6 (2019).

Journal Article | Published | English
Author
Mann, Monique; Matzner, TobiasLibreCat
Abstract
<jats:p> The potential for biases being built into algorithms has been known for some time (e.g., Friedman and Nissenbaum, 1996), yet literature has only recently demonstrated the ways algorithmic profiling can result in social sorting and harm marginalised groups (e.g., Browne, 2015; Eubanks, 2018; Noble, 2018). We contend that with increased algorithmic complexity, biases will become more sophisticated and difficult to identify, control for, or contest. Our argument has four steps: first, we show how harnessing algorithms means that data gathered at a particular place and time relating to specific persons, can be used to build group models applied in different contexts to different persons. Thus, privacy and data protection rights, with their focus on individuals (Coll, 2014; Parsons, 2015), do not protect from the discriminatory potential of algorithmic profiling. Second, we explore the idea that anti-discrimination regulation may be more promising, but acknowledge limitations. Third, we argue that in order to harness anti-discrimination regulation, it needs to confront emergent forms of discrimination or risk creating new invisibilities, including invisibility from existing safeguards. Finally, we outline suggestions to address emergent forms of discrimination and exclusionary invisibilities via intersectional and post-colonial analysis. </jats:p>
Publishing Year
Journal Title
Big Data & Society
Volume
6
Issue
2
Article Number
205395171989580
LibreCat-ID

Cite this

Mann M, Matzner T. Challenging algorithmic profiling: The limits of data protection and anti-discrimination in responding to emergent discrimination. Big Data & Society. 2019;6(2). doi:https://doi.org/10.1177/2053951719895805
Mann, M., & Matzner, T. (2019). Challenging algorithmic profiling: The limits of data protection and anti-discrimination in responding to emergent discrimination. Big Data & Society, 6(2), Article 205395171989580. https://doi.org/10.1177/2053951719895805
@article{Mann_Matzner_2019, title={Challenging algorithmic profiling: The limits of data protection and anti-discrimination in responding to emergent discrimination}, volume={6}, DOI={https://doi.org/10.1177/2053951719895805}, number={2205395171989580}, journal={Big Data & Society}, author={Mann, Monique and Matzner, Tobias}, year={2019} }
Mann, Monique, and Tobias Matzner. “Challenging Algorithmic Profiling: The Limits of Data Protection and Anti-Discrimination in Responding to Emergent Discrimination.” Big Data & Society 6, no. 2 (2019). https://doi.org/10.1177/2053951719895805.
M. Mann and T. Matzner, “Challenging algorithmic profiling: The limits of data protection and anti-discrimination in responding to emergent discrimination,” Big Data & Society, vol. 6, no. 2, Art. no. 205395171989580, 2019, doi: https://doi.org/10.1177/2053951719895805.
Mann, Monique, and Tobias Matzner. “Challenging Algorithmic Profiling: The Limits of Data Protection and Anti-Discrimination in Responding to Emergent Discrimination.” Big Data & Society, vol. 6, no. 2, 205395171989580, 2019, doi:https://doi.org/10.1177/2053951719895805.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]

Link(s) to Main File(s)
Access Level
Restricted Closed Access

Export

Marked Publications

Open Data LibreCat

Search this title in

Google Scholar