v2026.1CASRAI Dictionary 1,610 entries across 24 domains · CC-BY 4.01,610 entries · CC-BY 4.0

Dictionary termTrack CStablev2026.2

MLCommons benchmark

A benchmark published by the MLCommons consortium for measuring AI system performance under standardised workloads, datasets, and submission rules, with the principal suites being MLPerf Training, MLPerf Inference, and MLPerf HPC.

ByCASRAI Editorial Board

· Last updated 21 May 2026

Ask about MLCommons benchmark

Answers are drawn from this dictionary entry and the rest of the CASRAI corpus, with a link to every source.

Answers are AI-generated from CASRAI’s own published pages and can be wrong, so check the linked sources before relying on one; your question is logged without personal data — never sold, never used to train a third-party model — to show us what CASRAI is missing, so please do not type personal or confidential details. How we use this

Examples

Worked examples

Is an instance
A vendor's MLPerf Inference v4.0 submission for a server-class GPU.
Is an instance
A research group's open-division submission demonstrating a novel system architecture.

Counter-examples

Looks similar, but isn't

Not an instance
A single-paper benchmark report not subject to peer-submission review.
Not an instance
A leaderboard maintained on a personal blog.

Editorial commentary

MLCommons emphasises reproducible, audited performance numbers for hardware-software systems running canonical workloads. Submissions undergo peer review by other vendors. The benchmarks are widely cited in vendor marketing and procurement decisions, and have begun to expand into safety and trustworthy-AI evaluation.

References

Mattson et al., 'MLPerf Training Benchmark' (MLSys 2020); MLCommons technical reports.

Also known as

MLPerf

Machine-readable encodings

Use in your systems

JATS XML <role> element

xml

<role vocab="credit"
      vocab-identifier="https://casrai.org/dictionary/"
      vocab-term="MLCommons benchmark"
      vocab-term-identifier="https://casrai.org/dictionary/term/mlcommons-benchmark" />

Schema.org DefinedTerm (JSON-LD)

json

{
  "@context": "https://schema.org",
  "@type": "DefinedTerm",
  "@id": "https://casrai.org/dictionary/term/mlcommons-benchmark",
  "name": "MLCommons benchmark",
  "identifier": "https://casrai.org/dictionary/term/mlcommons-benchmark",
  "description": "A benchmark published by the MLCommons consortium for measuring AI system performance under standardised workloads, datasets, and submission rules, with the principal suites being MLPerf Training, MLPerf Inference, and MLPerf HPC.",
  "inDefinedTermSet": "https://casrai.org/dictionary/domain/ai-ml-research-outputs#set",
  "url": "https://casrai.org/dictionary/term/mlcommons-benchmark",
  "sameAs": [
    "MLPerf"
  ],
  "license": "https://creativecommons.org/licenses/by/4.0/",
  "publisher": {
    "@id": "https://casrai.org/#organization"
  },
  "dateModified": "2026-05-21T02:22:51",
  "inLanguage": "en"
}

Referenced across the research world

View CASRAI adoption →