Initiative

Intelligence and Autonomy

The Intelligence & Autonomy Initiative—active from 2014-2018—developed grounded, qualitative research in order to provide nuanced understanding of emerging technologies and to inform the design, evaluation, and regulation of AI-driven systems.

Rather than focus on utopian dreaming or dystopian fears, our work began from the position that the historical and social contexts in which AI systems emerge and operate should be central to debates about their uses and potential effects. To contribute to and develop these understandings, we produced empirical research ranging from an analysis of the ways in which service platforms, like Uber, may present a potential backdoor to employment discrimination to the history of aviation autopilot litigation and its implications for legal responsibility in autonomous systems. We also engaged a range of stakeholders, aiming to foster productive interdisciplinary and inter-institutional conversations. These engagements included invited talks and workshops, including Futures Forum 2015, a cross-disciplinary convening that used scenarios drawn from commissioned science fiction stories as a collective starting point for new and inclusive ways of planning for the future. We also published An AI Pattern Language, a booklet based on interviews conducted in 2015-2016 with practitioners working in the intelligent systems and AI industry that presents a taxonomy of social challenges facing AI industry practitioners and articulates an array of patterns that practitioners have developed in response.

The Intelligence & Autonomy Initiative was founded with support from the John D. and Catherine T. MacArthur Foundation and Microsoft Research, with additional research support from The Ethics and Governance of AI Fund.

Books

book | 09.29.16

An AI Pattern Language

Madeleine Clare Elish, Tim Hwang

D&S researchers Madeleine Clare Elish and Tim Hwang discuss the social challenges of AI in a new collection of essays, An AI Pattern Language. In A Pattern Language, the...
read more

Journal Articles

paper | 10.19.16

Discriminating Tastes: Customer Ratings as Vehicles for Bias

Alex Rosenblat, Karen Levy, Solon Barocas, Tim Hwang

D&S researchers Alex Rosenblat and Tim Hwang and D&S affiliates Solon Barocas and Karen Levy examine how bias may creep into evaluations of Uber drivers through consumer-sourced rating systems:...
read more

paper | 10.13.16

Regional Diversity in Autonomy and Work: A Case Study from Uber and Lyft Drivers

Alex Rosenblat, Tim Hwang

D&S researchers Alex Rosenblat and Tim Hwang explore “the significant role of worker motivations and regional political environments on the social and economic outcomes of automation” in this new...
read more

paper | 09.16.16

The Wisdom of the Captured

Alex Rosenblat, Tim Hwang

D&S researchers Alex Rosenblat and Tim Hwang analyze how widely captured data of technologies, which enable these technologies to make intelligent decisions, may negatively impact users. More broadly, how...
read more

paper | 03.20.16

Moral Crumple Zones: Cautionary Tales In Human-Robot Interaction

Madeleine Clare Elish

In this Working Paper from We Robot 2016, D&S Researcher Madeleine Elish employs the concept of “moral crumple zones” within human-machine systems as a lens through which to think about...
read more

paper | 02.24.15

Praise the Machine! Punish the Human! The Contradictory History of Accountability in Automated Aviation

Madeleine Clare Elish, Tim Hwang

Abstract: What will happen to current regimes of liability when driverless cars become commercially available? What happens when there is no human actor—only a computational agent—responsible for an accident?...
read more

Articles and Posts

EthnographyMatters.net | 06.28.16

The future of designing autonomous systems will involve ethnographers

Madeleine Clare Elish

D&S researcher Madeleine Clare Elish asserts ethnography and anthropology’s role in studying automation and intelligent systems. Cultural perceptions of the role of humans in automated and robotic systems need...
read more

Slate | 06.16.16

Letting autopilot off the hook

Madeleine Clare Elish

D&S researcher Madeleine Clare Elish discusses the complexities of error in automated systems. Elish argues that the human role in automated systems has become ‘the weak link, rather than...
read more

Harvard Business Review | 04.06.16

The Truth About How Uber’s App Manages Drivers

Alex Rosenblat

D&S Researcher Alex Rosenblat examines how Uber’s app design and deployment redistributes management functions to semiautomated and algorithmic systems, as well as to consumer ratings systems, creating ambiguity around...
read more

Slate | 03.08.16

How Politicians Should and Shouldn’t Use Twitter Bots

Tim Hwang, Samuel Woolley

D&S Researcher Tim Hwang and Samuel Woolley consider the larger trend toward automated politics and the likely future sophistication of automated politics and potential impacts on the public sphere...
read more

Vice | 09.18.15

Weapons of Mass Persuasion

Tim Hwang

“Just as the software and hardware of the internet has been militarized by the imperatives of a mostly secret ‘cyberwar,’ so too are online social spaces being weaponized in...
read more

Motherboard | 07.27.15

Uber’s Phantom Cabs

Alex Rosenblat

“Uber’s access to real-time information about where passengers and drivers are has helped make it one of the most efficient and useful apps produced by Silicon Valley in recent...
read more

Slate | 07.27.15

The Mirage of the Marketplace

Tim Hwang, Madeleine Clare Elish

“Increasingly, what underlies the debate over the so-called sharing economy is a nascent, bigger battle about how society wants machines coordinating and governing human activity. These apps don’t match...
read more

Quartz | 07.25.15

“Moral Crumple Zones”: When your self-driving car crashes, you could still be the one who gets sued

Madeleine Clare Elish, Tim Hwang

“In a self-driving car, the control of the vehicle is shared between the driver and the car’s software. How the software behaves is in turn controlled — designed —...
read more

Vice | 05.27.15

Might Intelligent Machines One Day Convince Us It’s Time to Die?

Tim Hwang, Madeleine Clare Elish

Data & Society’s Intelligence and Autonomy initiative commissioned authors to envision future scenarios for intelligent systems in four domains: medicine, labor, urban design, and warfare. The future scenario around...
read more

Civicist | 05.14.15

Bring on the Bots

Samuel Woolley, Tim Hwang

In this piece for Civic Hall’s Civicist, Samuel Woolley and D&S fellow Tim Hwang argue that “he failure of the ‘good bot’ is a failure of design, not a...
read more

Medium | 04.10.15

Back Stage at the Machine Theater

Karen Levy, Tim Hwang

D&S fellows Karen Levy and Tim Hwang ask after the ethics of design theater. Excerpt: “A machine’s front stage performance gets enacted through design. Just as a human provides...
read more

Primers

primer | 10.08.14

Future of Labor: Understanding Intelligent Systems

Alex Rosenblat, Tamara Kneese, danah boyd

Science fiction has long imagined a workforce reshaped by robots, but the increasingly common instantiation of intelligent systems in business is much more mundane. Beyond the utopian and dystopian...
read more

Press

Wired | 10.11.18

What does a fair algorithm actually look like?

Madeleine Clare Elish

For WIRED, Data & Society Research Lead Madeleine Clare Elish complicates algorithmic transparency. “‘Algorithmic transparency isn’t an end in and of itself,’ says Madeleine Clare Elish, a researcher who...
read more

Wired | 09.18.17

AI Research is in Desperate Need of an Ethical Watchdog

Jacob Metcalf

When Stonybrook University researchers launched NamePrism, an app that guesses someones ethnicity based off of their names, D&S researcher Jacob Metcalf identified the ethical issues apps like this can...
read more

Future of Life Institute | 03.22.16

AlphaGo and AI Fears

Madeleine Clare Elish

D&S fellow Madeleine Clare Elish was quoted in a Future of Life Institute piece discussing public fear of AI. “When the media focuses on AI in this way, it...
read more

PSFK | 12.16.15

Finding the Line Between Data Collection and Authenticity

Tim Hwang

D&S researcher Tim Hwang was interviewed by PSFK in the series, The Future of Digital Safety & Security: A Consumer Guide, to discuss policymaking around intelligence systems. “The issue...
read more

Past Events

Research Team

Madeleine Clare Elish

@m_c_elish

Tim Hwang

@timhwang

Subscribe to the Data & Society newsletter

Support us

Donate
Data & Society Research Institute 36 West 20th Street, 11th Floor
New York, NY 10011, Tel: 646.832.2038

Reporters and media:
[email protected]

General inquiries:
[email protected]

Unless otherwise noted this site and its contents are licensed under a Creative Commons Attribution 3.0 Unported license.