IPCO’s Technology Advisory Panel (TAP) AI Proportionality Assessment Framework

IPCO’s Technology Advisory Panel (TAP) release AI Proportionality Assessment Framework to Guide Ethical AI Development

The Technology Advisory Panel (TAP) has published it’s AI Proportionality Assessment Aid, a framework designed to guide the proportionality assessment of AI models. This aid, developed in collaboration with experts from the Centre for Emerging Technology and Security (CETaS) at The Alan Turing Institute, offers a structured approach to ensure AI models are the appropriate tool for their intended tasks.

The AI Proportionality Assessment Aid is a practical framework aimed at guiding the proportionality assessment of data driven AI models. It outlines key questions to consider throughout the AI model lifecycle: concept, development, operation and exploitation of results. This framework builds on the recent CETaS structured framework for assessing privacy intrusion, incorporating additional considerations and organising them according to the lifecycle stages. It serves as a valuable resource for model commissioners, designers, developers, testers, and those involved in governance.

Key Features:

• Concept Stage: Evaluates the necessity and appropriateness of AI approaches, considering biases, constraints, and policy for re-training/testing.
• Development Stage: Focuses on data sensitivities, human inspection, data volumes, biases, and integrity, ensuring robust data management practices.
• Operation Stage: Assesses the appropriateness of model use, data provenance, result delivery, and human inspection requirements.
• Exploitation Stage: Examines access to results, training for appropriate use, model chains, and reporting processes following adverse outcomes.

Dame Muffy Calder, Chair of the Technology Advisory Panel (TAP) said: “I am delighted to publish the Technology Advisory Panel’s AI Proportionality Assessment Aid. This document provides a practical and comprehensive framework for assessing the proportionality of AI models, ensuring they are the appropriate tool for the task at hand. It is designed to guide stakeholders through the AI model lifecycle, from concept, to model development, application, and exploitation of results. The focus is on data-driven models. We believe this aid will be an invaluable resource for those involved in the development, governance, and application of AI technologies”.

Contact: IPCOpressoffice@ipco.org.uk

Notes to Editors

The Technology Advisory Panel (TAP) was set up under the Investigatory Powers Act 2016. Its purpose is to advise the Investigatory Powers Commissioner and Judicial Commissioners on the impact of changing technology and the development of techniques to use investigatory powers whilst minimising privacy interference. The TAP is not a decision-making body. Its advice cannot constrain any decision of the Judicial Commissioners. Establishing and maintaining the TAP is a responsibility of the Investigatory Powers Commissioner.

This aid presents a practical framework to guide the proportionality assessment of an AI model. It does not represent IPCO policy.

The AI Proportionality Assessment Aid is now available for download at www.ipco.org.uk