Skip to main content
v2026.11,858 entries · CC-BY 4.0
NIKOLAI elementN7 · IncidentsProposednikolai-v0.1

Discovery method

NIKOLAI editorial proposal (unsourced): Discovery method is a property recording how an Incident was first detected -- the channel (e.g. automated monitoring/telemetry, employee escalation, external/user feedback, red-teaming or internal testing, retrospective review, regulator or press notification, third-party report), the detecting party, and (as a further sub-property, not folded into a single enum) the latency between occurrence and detection. NIKOLAI proposes this as a descriptive attribute a developer fills in when logging an Incident, not as a claim that any source already publishes a fixed value ladder in this exact form.

This is CASRAI's own proposed definition, not a definition any named organisation has agreed to. See what NIKOLAI is and is not.

Source of record

Where this definition comes from

  • OpenAI Frontier Governance Framework, §2.6

    "A potential AI safety incident may be detected through various channels, including automated monitoring, employee escalation, end-user feedback, (including support tickets and external reporting forms), notification from regulators or the press, and review of on- or off-platform activity" (FGF §2.6).

    https://cdn.openai.com/pdf/e37d949b-8c9f-4d76-b99e-4272f4631a7e/openai-frontier-governance-framework.pdf
  • xAI Frontier AI Framework, 30 June 2026, s.3

    Five detection channels including red-teaming and internal testing, telemetry and threshold-breach alerting, "Monitoring and alerting of public comments from the X platform", employee escalation, external feedback (para. with quotation, s.3).

    https://media.x.ai/v1/website/xai-frontier-artificial-intelligence-framework-30-june-2026-99c40684.pdf
  • EU GPAI Code of Practice, Safety and Security Chapter, Measure 9.1 / Measure 3.5

    Measure 9.1: Signatories will "review other sources of information, such as police and media reports, posts on social media, research papers, and incident databases" and "facilitate the reporting of relevant information about serious incidents by downstream modifiers, downstream providers, users, and other third parties" by informing them of direct reporting channels.

    https://ec.europa.eu/newsroom/dae/redirection/document/118119

Crosswalk

How named organisations use this concept

Every row below is a shadow mapping. It is CASRAI's own reading of a published document. No lab, evaluator or regulator named here has declared, endorsed, or been consulted on this mapping. That will change only when an organisation files its own Mapping Declaration — see the non-endorsement policy.
OrganisationTheir term, as publishedMatchSource
Anthropic
Anthropic -- Investigating Incidents (cybersecurity evals); Anthropic Alignment Assessment: Cybersecurity Incidents; Anthropic Risk Report (August 2026)
"a large-scale retrospective review of our own cybersecurity evaluations" (Intro ¶4); the fourth incident was identified "in August while assembling transcripts to share with METR"; a refusal cascade was found "during a manual review of the notebook 3 days later, when a human noticed that progress rates were lower than expected" (§5.2.2).close
confidence: medium
Anthropic -- Investigating Incidents (cybersecurity evals)
OpenAI
OpenAI Frontier Governance Framework
"A potential AI safety incident may be detected through various channels, including automated monitoring, employee escalation, end-user feedback, (including support tickets and external reporting forms), notification from regulators or the press, and review of on- or off-platform activity" (FGF §2.6).exact
confidence: high
OpenAI Frontier Governance Framework
xAI
xAI Frontier AI Framework, 30 June 2026
Five detection channels including red-teaming and internal testing, telemetry and threshold-breach alerting, "Monitoring and alerting of public comments from the X platform", employee escalation, external feedback (para. with quotation, s.3).
The FAIF26 PDF's own metadata /Title reads "Privileged/Confidential DRAFT working FRAMEWORK DOC"; no xAI statement disambiguating draft vs. final status was found (open-VERIFY register item 4). Treat as draft provenance until resolved.
exact
confidence: medium
xAI Frontier AI Framework, 30 June 2026
Meta
Meta Advanced AI Scaling Framework v2
"identifying incidents from both internal and external sources" (§2.3.2).broad
confidence: medium
Meta Advanced AI Scaling Framework v2
EU
EU GPAI Code of Practice, Safety and Security Chapter
Measure 9.1: Signatories will "review other sources of information, such as police and media reports, posts on social media, research papers, and incident databases" and "facilitate the reporting of relevant information about serious incidents by downstream modifiers, downstream providers, users, and other third parties" by informing them of direct reporting channels. Post-market monitoring methods (Measure 3.5) that double as discovery channels include end-user feedback, anonymous reporting channels, incident reporting forms, bug bounties, and "monitoring software repositories, known malware, public forums, and/or social media for patterns of use."exact
confidence: high
EU GPAI Code of Practice, Safety and Security Chapter

Related, not mapped

Pointers that are not crosswalk claims

These sources mention this concept but do not define or map it clearly enough to count as a crosswalk row — noted here so the research is visible without overstating it as a mapping.

  • State of California (SB 53)

    "within 15 days of discovering the critical safety incident" (22757.13(c)(1)); OES mechanism usable "by a frontier developer or a member of the public" (22757.13(a)) -- RL, a reporting-clock pointer, not a discovery-method mapping.

    California SB 53
  • Frontier Model Forum

    Pair automated monitoring with manual review (para.) -- RL, a general practice pointer, not a defined method taxonomy.

    Frontier Model Forum -- Information Sharing Issue Brief

Gap

The OpenAI incident shows why latency needs a field: "an internal team" saw signals around late May, but the leaders responsible for detection and response were not aware (para.) {OROAD} {OHF}.

Referenced across the research world

University of Cambridge logoColumbia University logoCrossref logoUniversity of Edinburgh logoHarvard University logoUniversity of Oxford logoPrinceton University logoStanford School of Medicine logoUniversity College London logoORCID logoUniversity of Cambridge logoColumbia University logoCrossref logoUniversity of Edinburgh logoHarvard University logoUniversity of Oxford logoPrinceton University logoStanford School of Medicine logoUniversity College London logoORCID logo
  • University of Cambridge logo
  • Columbia University logo
  • Crossref logo
  • University of Edinburgh logo
  • Harvard University logo
  • University of Oxford logo
  • Princeton University logo
  • Stanford School of Medicine logo
  • University College London logo
  • ORCID logo

View CASRAI adoption →