Examples
Worked examples
- Is an instance
A model card declaring '~3.8 x 10^25 training FLOPs'.
- Is an instance
A regulator's classification of a model as systemic-risk based on the FLOPs estimate.
Counter-examples
Looks similar, but isn't
- Not an instance
Reporting only GPU-hours (related but hardware-coupled).
- Not an instance
Reporting energy consumption (related but not identical).
Editorial commentary
Training FLOPs are estimated from the standard 6 N D approximation for transformer training (6 times parameter count times tokens), with refinements for MoE and non-dense architectures. The metric appears in EU AI Act thresholds for systemic-risk classification (10^25 FLOPs) and US executive orders (10^26 FLOPs).
References
- Hoffmann et al., 'Training Compute-Optimal Large Language Models' (NeurIPS 2022); EU AI Act Article 51 systemic-risk threshold.
Also known as
training FLOPs · training compute
Machine-readable encodings
Use in your systems
xml
<role vocab="credit"
vocab-identifier="https://casrai.org/dictionary/"
vocab-term="Compute (FLOPs estimate)"
vocab-term-identifier="https://casrai.org/dictionary/term/compute-flops-estimate" />json
{
"@context": "https://schema.org",
"@type": "DefinedTerm",
"name": "Compute (FLOPs estimate)",
"identifier": "https://casrai.org/dictionary/term/compute-flops-estimate",
"description": "The total floating-point operations consumed by training a model, conventionally reported as a single number (e.g., 3.0 x 10^25 FLOPs) used as a regulatory and scientific proxy for training-run scale.",
"inDefinedTermSet": "https://casrai.org/dictionary/domain/ai-and-ml-research-outputs/",
"url": "https://casrai.org/dictionary/term/compute-flops-estimate",
"sameAs": [
"training FLOPs",
"training compute"
],
"license": "https://creativecommons.org/licenses/by/4.0/"
}
