TTC Joint Roadmap on Evaluation and Measurement Tools for Trustworthy AI and Risk Management

• Authority: Other multinational
• Jurisdiction: Multinational
• Collections: Multinational
• Most recent activity: Enacted
• Most recent activity date: 2022-12-01

Risk subdomain coverage

Good coverage — Comprehensive governance measures or mitigations with clear procedures relating to the risk subdomain are explicitly described.

• Governance failure
• Lack of capability or robustness
• Lack of transparency or interpretability

Minimal coverage — Brief mention but no specific mitigations, recommendations or governance measures relating to the risk subdomain are described.

• Unfair discrimination and misrepresentation
• Unequal performance across groups
• AI system security vulnerabilities
• False or misleading information
• Competitive dynamics
• Environmental harm

All other risk subdomains had no coverage in this document.

Risk Coverage Summary

The document has minimal to good coverage of approximately 8-10 subdomains, with primary focus on AI system safety and governance domains (7.3, 7.4, 6.5, 6.4), and some coverage of discrimination (1.1, 1.3), security (2.2), misinformation (3.1), and environmental harm (6.6). The document emphasizes risk management frameworks, standards development, and evaluation methodologies rather than specific risk harms.

Sector coverage

Minimal coverage — Brief mention but no specific mitigations, recommendations or governance measures relating to the sector are described.

• Scientific Research & Development Services
• Public Administration (excl. National Security)

All other sectors had no coverage in this document.

Sectors Summary

This is a cross-sectoral governance framework that does not target specific economic sectors. It establishes voluntary cooperation mechanisms for AI standards and risk management applicable across all sectors where AI is developed or deployed.

Legislative Status

Soft Law

Legislative Status Summary

This is a non-binding joint roadmap establishing voluntary cooperation between the U.S. and EU on AI standards and risk management, with no enforcement mechanisms, penalties, or mandatory obligations.

Actors

Proposer

• Entity Types: AI_Governance_Actor
• Entities: United States Government; European Union; Trade and Technology Council (TTC); National Institute of Standards and Technology (NIST); White House Office of Science and Technology Policy (OSTP); European Commission
• Summary: The document is a joint initiative proposed by the U.S. and EU through the Trade and Technology Council, with specific contributions from NIST and OSTP on the U.S. side and EU regulatory bodies.

Target

• Entity Types: AI_Developer, AI_Deployer, AI_Governance_Actor
• Entities: industry; academia; civil society organizations; standards development organizations; start-ups and small and medium-sized enterprises; governments
• Summary: The roadmap targets a broad range of stakeholders across the AI ecosystem including developers, deployers, standards organizations, and government entities who will participate in standards development and risk management activities.

Enforcer

• Summary: No enforcement mechanisms or enforcement bodies are specified in this voluntary cooperation roadmap. The document is non-binding and relies on voluntary participation.

Monitor

• Entity Types: AI_Governance_Actor
• Entities: Expert working groups; Organisation for Economic Co-operation and Development (OECD); OECD Working Party on AI Governance (AIGO); OECD Network of AI Experts (ONE.AI)
• Summary: The document establishes expert working groups to monitor progress and references OECD bodies that will track AI risks and standards development, though monitoring is primarily for coordination rather than enforcement.

AI Lifecycle Stages

Lifecycle stages covered by the documents, as defined in the OECD Framework for the Classification of AI Systems

• Plan and Design
• Build and Use Model
• Verify and Validate
• Deploy
• Operate and Monitor

AI Lifecycle Summary

The document covers multiple AI lifecycle stages with primary emphasis on Plan and Design, Verify and Validate, and Operate and Monitor stages. It focuses extensively on developing standards, evaluation methodologies, and risk management frameworks that span the entire AI lifecycle.

Technical Scope

Terms relating to technical scope that are mentioned or implicitly referenced in the document

• AI Systems
• Open Weight / Open Source

Technical Scope Summary

The document broadly references AI systems and AI technologies without defining specific technical categories. It does not explicitly mention frontier AI, general purpose AI, foundation models, generative AI, predictive AI, open-weight models, or compute thresholds.