The fields of AI and data science have exploded in the last two decades, now accounting for 3% of all peer-reviewed journal publications and 9% of published paper conferences in all scientific fields. AI and data science techniques are also leading to advances in other academic domains such as history, economics, genomics, biology, and more.
However, traditional research governance and ethical accountability processes have struggled to keep pace with the growth of these fields. Public and private institutions have faced challenges establishing processes to flag, review, and mitigate the unique ethical challenges posed by AI and data science research, which can include the treatment of data curators and labellers, dataset and model documentation standards, consent and privacy risks, the identification of indirect and long-term beneficiaries, and evaluations of potential collaborators, data sources and funders, amongst other concerns.
These failures come with high stakes – as several prominent researchers have highlighted, inadequately reviewed research can unleash a deluge of ethical risks that are carried downstream into subsequent products, services, and follow-on research. They also pose a risk to the longevity of the field – if researchers fail to demonstrate due consideration for the ethical implications of their work, it may become a domain that future researchers find undesirable to work in, a challenge that both the nuclear power and tobacco research have encountered. Even worse, poor practices could set a precedent of future normative standards of ‘acceptable’ research.
Research ethics committees (RECs, also known as institutional review boards, or IRBs, in the USA) are charged with ensuring researchers comply with ethical norms and legal requirements, but often with a narrow focus on research involving human beings as research subjects and data protection issues. Beyond research methods, RECs could find themselves poorly equipped to evaluate the wider societal impacts of AI research such as considerations for the public good and the ethics of incidental findings.
While there are nascent cross-industry initiatives that have sprung up to broaden the discussion of how researchers can navigate ethical risks, and some researchers have even begun to unpack the challenge of how to design and launch an AI research review committee, there remain few detailed and robust methodological resources available to analyse and resolve AI and data-based ethics problems.
To address this challenge, the Ada Lovelace Institute, the Institute for Data Science and AI at the University of Exeter, and the Alan Turing Institute are co-convening a series of workshops with experts from academia and industry who have experience and expertise establishing and managing institutional ethics review processes.
These workshops will explore cutting-edge practical frameworks, data ethics review processes and research governance models that can be implemented to address the unique ethical risks that are emerging in association with data science and AI research. Building from shared experiences, challenges and insights into today’s best practices, these workshops will contribute to the development of state-of-the-art institutional review procedures for AI research labs and university departments across the UK and EU.
Our hope is these workshops will identify the types of challenges RECs are facing, develop some recommendations for how RECs can address these issues, and articulate what kinds of frameworks, processes and governance practices could support RECs in future.
We are grateful to the Arts and Humanities Research Council who have sponsored this work with a £100k grant.
Image credit: AnthiaCumming
Report with recommendations and findings of a public deliberation on biometrics technology, policy and governance