AI Advancement and Reliability Act of 2024

The AI Advancement and Reliability Act of 2024 amends the National Artificial Intelligence Initiative Act of 2020 to establish a Center for AI Advancement and Reliability within the National Institute of Standards and Technology (NIST). The Center aims to ensure U.S. leadership in research, development, and evaluation of AI system reliability, robustness, resilience, security, and safety. It defines terms like 'artificial intelligence red teaming' and 'artificial intelligence system,' and updates the NIST Act to extend the expiration of a hiring authority for critical technical experts from 5 to 7 years.

Sec. 2, Artificial Intelligence Advancement and Reliability: This section adds definitions for 'artificial intelligence red teaming' (structured adversarial testing to find flaws) and 'artificial intelligence system' (as defined in the Advancing American AI Act), and defines 'Federal laboratory' under the Stevenson-Wydler Act.

Sec. 5304, Center for AI Advancement and Reliability: The Under Secretary of Commerce for Standards and Technology must establish this Center, subject to appropriations, to advance measurement science for AI reliability, support NIST labs, collaborate on voluntary standards, and educate governments and the public. The Center may conduct evaluations, develop best practices and standards, provide input to federal agencies, engage internationally, and coordinate federal research. It must support research on AI risks, assess deployment scenarios for economic or national security risks, leverage resources from various sectors, avoid duplication with NIST lab activities, and submit annual reports to Congress starting fiscal year 2026.

Sec. 5304(b), Establishment of Consortium: The Under Secretary must create a consortium of stakeholders from academia, federal labs, industry, and civil society to support the Center and NIST. The consortium will evaluate stakeholder needs, identify gaps in Center activities, and provide recommendations. A report on consortium contributions is due two years after enactment.

Sec. 5304(c)-(h): The Center and consortium must adhere to scientific integrity policies with confidential reporting mechanisms. The section must be carried out in accordance with certain security provisions. Information shared with NIST for these activities cannot be used to regulate the sharing entity. The section does not grant new enforcement or regulatory authority, require data sharing from private entities, or modify existing reporting requirements. The section sunsets six years after enactment, and $10 million is authorized for fiscal year 2025.

Sec. 2(c)-(d): The NIST Act is amended to extend the expiration of a hiring authority for critical technical experts from 5 to 7 years. The table of contents is updated to include the new section 5304.