LexLint.ioBeta

Know the law your code answers to.

Law / Frameworks / NIST AI 200-2

NIST TEVV-Athlon Framework for Evaluating AI Systems

Below are its 10 steps in the framework's own order, and under each one the laws we track that bear on it. Each mapping is our reading that a law bears on a step, never a finding that running the step meets the law.

Draft National Institute of Standards and Technology released this edition as a draft, and the final edition may differ. We check its page every week, and a new edition is read against the law again. Every draft we track

Where the law lands in the framework

4of 10 steps have law88laws40jurisdictions

2.1: no law we track2.2: 3 laws in 2 jurisdictions2.3: 78 laws in 37 jurisdictions2.3 782.4: 13 laws in 11 jurisdictions2.4 134.1: no law we track4.2: no law we track4.3: 79 laws in 37 jurisdictions4.3 794.4: no law we track4.5: no law we track4.6: no law we track24

Of these laws, 52 are in force, 30 not yet in force, and 6 proposed and not law.

5 of the 6 steps under General Guidance for a TEVV-Athlon have no law we track under them.

  • in force
  • not yet in force
  • blocked by a court
  • proposed
  • no law we track
A bar's height is its number of laws. Select one to open the step.

Read through the kinds of duty each AI, scraping and news aggregation law we track carries, counting a kind of duty only where the law's own requirement lines, as read against the NIST AI Risk Management Framework, bear it out.

The TEVV-Athlon Framework

3 of 4 steps with law

The TEVV-Athlon Framework is a structured approach to developing assessments of AI systems. The framework can help organizations assess system attributes, trustworthiness characteristics, and operational goals relevant to their needs.

StepWhat it saysLaws, by stateLawsJurisdictionsNot yet in forceProposed
2.1 Articulate & Organize no law we track no law we track
2.2 Define & Construct 3 laws, 1 not yet in force 3 2 1 0
2.3 Apply & Measure 78 laws, 27 not yet in force, 1 proposed 78 37 27 1
2.4 Synthesize & Interrogate 13 laws, 2 not yet in force, 5 proposed 13 11 2 5

General Guidance for a TEVV-Athlon

1 of 6 steps with law

This section provides an overview of general techniques and practices that may support a TEVV-Athlon across different systems, applications, and stages of the AI lifecycle.

StepWhat it saysLaws, by stateLawsJurisdictionsNot yet in forceProposed
4.1 Gathering Appropriate Expertise no law we track no law we track
4.2 Checking Basic TEVV-Athlon Requirements, Resources, and Materials no law we track no law we track
4.3 Composing a TEVV Toolbox 79 laws, 28 not yet in force, 1 proposed 79 37 28 1
4.4 Applying Best Practices for Scientific Measurement no law we track no law we track
4.5 Validating Measurement no law we track no law we track
4.6 Beware of Goodhart’s Law no law we track no law we track

Where the law and the framework part

6 of the 10 steps have no law we track under them.

Kinds of duty this framework has no step for: access restriction, age verification, attribution, biometric, breach notice, consent, content labelling, contract terms, data subject rights, design code, disclosure, licensing, prohibition, reporting, retention, TDM, transfer.

The framework's text

Excerpts of the NIST TEVV-Athlon Framework for Evaluating AI Systems, public domain (a US government work).

Read it from the publisher: doi.org