Life and the Law in the Era of Data-Driven Agency
Show Less

Life and the Law in the Era of Data-Driven Agency

Edited by Mireille Hildebrandt and Kieron O’Hara

This ground-breaking and timely book explores how big data, artificial intelligence and algorithms are creating new types of agency, and the impact that this is having on our lives and the rule of law. Addressing the issues in a thoughtful, cross-disciplinary manner, leading scholars in law, philosophy, computer science and politics examine the ways in which data-driven agency is transforming democratic practices and the meaning of individual choice.
Buy Book in Print
Show Summary Details
You do not have access to this content

Chapter 12: Throttling machine learning

Paul Ohm

Abstract

This chapter offers two ‘throttling metrics’, quantitative measurements of some aspect of a machine learning system. These metrics can be used to regulate our ability to control the way machine learning systems impinge on important human values. The first metric measures the ratio between the performance of an artificial intelligence system to the human decision-maker who today serves the same purpose. Too often we implicitly (or sometimes explicitly) set the target of this metric at the value of one, at simple equivalence. Any AI that performs ‘as well as’ a human is ready to be deployed. Instead, we would often be better off setting this metric at a higher value, requiring an artificial intelligence to be two or three or even fifty times better than a human before it should be deployed. The second metric measures the incompleteness of the data used to train a machine learning system. Machine learning experts have been given access to more information about human behavior than ever before. In this environment, anything that forces a researcher to analyze less than the maximum amount of available data, for example a privacy rule allowing an individual to opt-out of the research, has begun to be characterized as deviant or anti-science. We should instead sometimes consider the forced contraction of training datasets as a second metric, something we should protect and preserve rather than try to argue out of existence.

You are not authenticated to view the full text of this chapter or article.

Elgaronline requires a subscription or purchase to access the full text of books or journals. Please login through your library system or with your personal username and password on the homepage.

Non-subscribers can freely search the site, view abstracts/ extracts and download selected front matter and introductory chapters for personal use.

Your library may not have purchased all subject areas. If you are authenticated and think you should have access to this title, please contact your librarian.


Further information

or login to access all content.