Examples
Worked examples
- Is an instance
A vendor's MLPerf Inference v4.0 submission for a server-class GPU.
- Is an instance
A research group's open-division submission demonstrating a novel system architecture.
Counter-examples
Looks similar, but isn't
- Not an instance
A single-paper benchmark report not subject to peer-submission review.
- Not an instance
A leaderboard maintained on a personal blog.
Editorial commentary
MLCommons emphasises reproducible, audited performance numbers for hardware-software systems running canonical workloads. Submissions undergo peer review by other vendors. The benchmarks are widely cited in vendor marketing and procurement decisions, and have begun to expand into safety and trustworthy-AI evaluation.
References
- Mattson et al., 'MLPerf Training Benchmark' (MLSys 2020); MLCommons technical reports.
Also known as
MLPerf
Machine-readable encodings
Use in your systems
xml
<role vocab="credit"
vocab-identifier="https://casrai.org/dictionary/"
vocab-term="MLCommons benchmark"
vocab-term-identifier="https://casrai.org/dictionary/term/mlcommons-benchmark" />json
{
"@context": "https://schema.org",
"@type": "DefinedTerm",
"name": "MLCommons benchmark",
"identifier": "https://casrai.org/dictionary/term/mlcommons-benchmark",
"description": "A benchmark published by the MLCommons consortium for measuring AI system performance under standardised workloads, datasets, and submission rules, with the principal suites being MLPerf Training, MLPerf Inference, and MLPerf HPC.",
"inDefinedTermSet": "https://casrai.org/dictionary/domain/ai-and-ml-research-outputs/",
"url": "https://casrai.org/dictionary/term/mlcommons-benchmark",
"sameAs": [
"MLPerf"
],
"license": "https://creativecommons.org/licenses/by/4.0/"
}
