Tag: chatbot ai act disclosure

  • AI-Generated Content Code of Practice: What It Means for Journals and Preprint Servers

    The AI-Generated Content Code of Practice is the European Commission’s voluntary framework, published 10 June 2026, that helps providers and deployers of generative AI systems meet the labelling and disclosure duties in Article 50 of the EU AI Act. For journals and preprint servers, the Code’s “editorial responsibility” carve-out is the single most consequential clause: it determines whether peer-reviewed articles, preprints, and AI-assisted manuscript text trigger a public AI-disclosure requirement.

    The Code of Practice on Transparency of AI-Generated Content is a non-binding compliance instrument: it is a voluntary set of practical measures that signatories can use as evidence of compliance with the legally binding transparency obligations set out in Article 50 of Regulation (EU) 2024/1689, the EU AI Act.

    What is the AI-Generated Content Code of Practice?

    The Code of Practice on Transparency of AI-Generated Content was closed out at a plenary session on 10 June 2026, following a drafting process that ran from November 2025 through three drafting rounds, the last concluding on 8 May 2026. It was produced by the European Commission’s AI Office through two working groups: one covering obligations for providers of generative AI systems, the other covering obligations for deployers — the organisations that actually publish AI-generated or AI-assisted output.

    Providers must ensure that generated audio, image, video, and text outputs are marked in a machine-readable format detectable as artificial, using layered technical measures such as metadata and watermarking. Deployers must clearly label deepfakes and must disclose AI-generated text on matters of public interest unless that text has undergone human review and is subject to editorial responsibility. That single exemption clause is what makes the Code directly relevant to scholarly publishing.

    Article 50 vs Article 56: two different codes, not one

    Publishers should not confuse this Code with the earlier General-Purpose AI Code of Practice, finalised on 10 July 2025 under Article 56 of the AI Act. That code addresses safety, security, and copyright compliance for developers of foundation models such as GPT- and Gemini-class systems — it is not about labelling published content.

    The June 2026 Code sits under Article 50 instead, and governs transparency obligations that apply from 2 August 2026, when the wider AI Act’s transparency provisions take effect. Confusing the two codes is the most common error in early legal commentary on this development, and it matters for publishers: it is Article 50 — not Article 56 — that determines whether an AI-assisted peer-review report, cover letter, or manuscript summary requires a visible “AI” label.

    What this means for journal editorial workflows

    Peer-reviewed journal articles are the clearest case for the editorial-responsibility exemption. A manuscript that has passed through peer review, editorial decision-making, and copyediting has, by definition, undergone the “human review… subject to editorial responsibility” that Article 50(4) requires to avoid the public-disclosure trigger for AI-generated text.

    This does not remove the underlying disclosure obligation that scholarly publishing already imposes through its own ethics infrastructure. ICMJE’s Recommendations state that AI tools cannot be credited as authors because they cannot take responsibility for the submitted work, and that any generative AI use in manuscript preparation must be disclosed to editors and readers. COPE’s position statement on AI tools reaches the same conclusion: AI cannot be an author, and authors remain fully accountable for content it helped produce. The EU Code’s editorial-responsibility test and the ICMJE/COPE disclosure rule are therefore complementary, not duplicative — a journal that already enforces ICMJE-COPE disclosure norms is well placed to document compliance with the EU Code if it chooses to sign.

    • Editorial policy: confirm the AI-use disclosure clause in author guidelines references generative AI text, not only images or data.
    • Peer review reports: reviewers using AI drafting tools should disclose this to editors, mirroring the deployer disclosure logic in the Code.
    • Editorial metadata: retain records evidencing human review, since this is the documentation that supports the Article 50(4) exemption claim.

    Preprint servers: a narrower exemption path

    Preprints are structurally different. A preprint is, by design, posted before formal peer review and before an editorial board takes responsibility for its content. That means the “editorial responsibility” exemption that shelters a published journal article is much harder for a preprint server to claim at the point of posting.

    Preprint servers such as arXiv, bioRxiv, and medRxiv already run moderation screening, but screening for scope and plagiarism is not the same as the substantive editorial review Article 50(4) contemplates. Where a preprint contains AI-generated text on a matter of public interest — a policy-relevant synthesis, a public-health claim — a strict reading of the Code suggests deployer-side disclosure obligations may apply at the preprint stage, even though the same text would likely be exempt once it clears peer review and is published in a journal. Preprint operators serving EU users should treat this as a genuine compliance gap to close, not an afterthought.

    Content type Human review / editorial responsibility present? Likely Article 50 disclosure trigger
    Peer-reviewed journal article Yes — editorial board, peer review, copyediting Exempt (if AI use is disclosed per ICMJE/COPE norms)
    Preprint (pre-review) Limited — screening only, no substantive editorial review Disclosure obligation more likely to apply
    AI-generated figure or image (deepfake-style) Not applicable — separate deployer rule Labelling required regardless of review stage
    AI-assisted literature-review drafting Depends on subsequent editorial handling Case-by-case; disclose per journal policy

    Answer-first Q&A

    Is the AI-Generated Content Code of Practice mandatory?

    No. The Code of Practice is voluntary; signing it is optional. What is legally binding is Article 50 of the EU AI Act itself, which applies from 2 August 2026. Signing the Code simply gives providers and deployers, including publishers, a recognised route to demonstrate compliance with those binding obligations.

    Does the Code of Practice apply to preprints?

    The Code applies to any deployer publishing AI-generated text on matters of public interest to EU audiences, which can include preprint servers. Because preprints have not undergone substantive editorial review at posting, the editorial-responsibility exemption is harder to claim than for peer-reviewed journal articles, making preprint-stage disclosure more likely to be required.

    Can AI-generated text be listed as an author contribution?

    No. ICMJE and COPE both hold that generative AI tools cannot qualify as authors because they cannot be held accountable for the work or approve the final version. Human authors must disclose AI use and retain full responsibility for accuracy, originality, and integrity of the resulting manuscript text.

    How does this Code differ from the GPAI Code of Practice?

    The GPAI Code of Practice (Article 56, July 2025) governs foundation-model developers’ safety, security, and copyright duties. The AI-Generated Content Code of Practice (Article 50, June 2026) instead governs labelling and disclosure of AI-generated outputs by the organisations that publish them — the code directly relevant to journals and preprint servers.

    Implications and a compliance checklist

    For the publisher segment of CASRAI’s audience, the practical task is narrow but time-sensitive: journals should audit whether their existing ICMJE/COPE-aligned AI-disclosure clauses reference the Code’s editorial-responsibility test, and preprint operators serving EU readers should assess whether pre-review screening is sufficient to avoid a deployer-side disclosure obligation once Article 50 takes effect on 2 August 2026.

    • Map current author-guideline AI-disclosure language against Article 50(4)’s “human review and editorial responsibility” wording.
    • Confirm peer review and editorial sign-off records are retained as exemption evidence.
    • Assess whether preprint-stage moderation constitutes “editorial responsibility” under a plain reading of the Code, or whether additional review is needed.
    • Track AI Office guidance and signatory lists, since the Code’s practical measures may evolve as more publishers sign.

    Institutions coordinating research-integrity policy across editorial offices and research administration functions should treat this as a live compliance item for the second half of 2026, and align it with existing authorship disclosure norms rather than treating it as a separate, parallel rulebook.

  • AI Act Article 50 Transparency in Research Tools

    The EU AI Act’s Article 50 transparency obligations apply from 2 August 2026 and require any research chatbot, literature-review assistant or generative lab tool that interacts with people or produces synthetic content to disclose that it is AI. This duty is separate from the machine-readable watermarking requirement in Article 50(2), which the AI Omnibus provisional agreement has pushed back to 2 December 2026 for generative systems already on the market — so procurement teams cannot treat the whole article as delayed.

    Article 50 of Regulation (EU) 2024/1689 is the EU AI Act provision that sets disclosure duties for AI systems that interact directly with people, generate synthetic content, perform emotion recognition or biometric categorisation, or produce deepfakes and AI-written public-interest text. For research offices, this covers a growing shelf of everyday tools: AI-assisted literature-review platforms, participant-facing chatbots, lab-based generative-image tools and AI drafting assistants used in public engagement.

    What does Article 50 actually require?

    Article 50 sets out four distinct disclosure duties, and a research tool can trigger more than one at once. Under Article 50(1), providers of systems intended to interact directly with people — chatbots, virtual assistants, conversational research interfaces — must design them so users are told they are dealing with AI, at the latest by the first interaction. Draft Commission Guidelines published on 8 May 2026 confirm that AI agents fall within this duty, and that disclosure must be repeated where a single notice at the outset would not be obvious later in the exchange.

    Article 50(2) requires providers of generative AI to mark synthetic audio, image, video or text outputs in a machine-readable, detectable format. Article 50(3) requires deployers of emotion-recognition or biometric-categorisation systems to inform exposed individuals, alongside GDPR Articles 12–14. Article 50(4) requires deployers to label deepfakes and disclose AI-generated public-interest text, unless a named person holds editorial responsibility after substantive human review.

    What applies from August 2026, regardless of the watermarking delay?

    The full transparency regime enters into force on 2 August 2026. Only one obligation has been pushed back: the AI Omnibus provisional agreement of May 2026 gives generative AI systems already placed on the market before that date until 2 December 2026 to meet the machine-readable marking requirement in Article 50(2). Nothing else in Article 50 moves.

    That means the disclosure duties most relevant to research offices are unaffected by the delay:

    • Article 50(1) chatbot and virtual-assistant disclosure applies from 2 August 2026 in full.
    • Article 50(3) emotion-recognition and biometric-categorisation disclosure applies from 2 August 2026 in full.
    • Article 50(4) deepfake and public-interest text labelling applies from 2 August 2026 in full.
    • Only the technical marking format under Article 50(2) has a grace period, and only for pre-existing systems.

    A research office that assumes “the watermarking clause is delayed, so we have more time” is conflating one narrow technical carve-out with the whole article. The European Commission’s own Compliance Checker data indicates transparency obligations are the second most common compliance trigger after AI literacy, affecting around 33% of organisations that have assessed themselves against the Act.

    Which research AI tools are caught by Article 50?

    Most research-facing AI tools map cleanly onto one or more Article 50 provisions. The table below sets out the mapping research offices should use when auditing procured and internally built tools.

    Research AI tool type Article 50 provision Who must act Deadline
    Literature-review or systematic-review chatbot assistant 50(1) — AI interaction disclosure Deployer (institution), if using a third-party tool; provider, if built in-house 2 August 2026
    Participant recruitment or survey chatbot 50(1) — AI interaction disclosure Deployer 2 August 2026
    Lab tool generating synthetic images, audio or text (e.g. synthetic dataset generation) 50(2) — machine-readable marking Provider 2 August 2026; pre-existing systems to 2 December 2026 for marking only
    Emotion-recognition or biometric-categorisation research instrument 50(3) — disclosure to exposed individuals Deployer 2 August 2026
    AI-drafted public engagement or press content 50(4) — public-interest text labelling Deployer, unless human-reviewed with editorial responsibility 2 August 2026

    Note that the same tool often needs two audits: a chatbot that also produces AI-written summary text for publication can trigger both 50(1) and 50(4).

    Does the research exemption cover the tools you actually use?

    Recital 25 of the AI Act exempts AI systems and models developed and put into service for the sole purpose of scientific research and development. This exemption is narrower than it sounds. It covers AI built as the object of research — a novel model a lab is developing and testing — not commercial or off-the-shelf tools that a research team merely uses to do research.

    A university deploying a commercially available literature-review assistant, a general-purpose chatbot, or a vendor’s lab-imaging tool does not benefit from the Recital 25 carve-out for that deployment. The institution acts as a deployer under Article 50 the moment that tool interacts with people or generates in-scope content, regardless of the research being scientific in nature. Procurement teams should not assume “we’re a research organisation” is itself an exemption — the exemption attaches to the AI system’s development purpose, not the purpose of the team using it.

    Common questions on Article 50 and research AI

    What are the transparency obligations under Article 50 of the AI Act?

    Article 50 sets four disclosure duties: providers of interactive AI (chatbots, assistants) must flag their AI nature at first contact; providers of generative AI must mark synthetic outputs; deployers using emotion-recognition or biometric tools must inform exposed individuals; and deployers publishing deepfakes or AI-written public-interest text must label it as such, unless human-reviewed.

    What is the EU Code of Practice on AI-generated content?

    It is a voluntary Commission-coordinated framework covering Article 50(2) and 50(4), setting a standardised EU visual label for AI content, a taxonomy separating fully AI-generated from AI-assisted material, and modality-specific labelling guidance. A second draft was published in March 2026, with a final version expected by June 2026.

    Why has Article 50’s transparency obligation been criticised as insufficient?

    Academic analysis, including work published via the University of Glasgow’s repository, argues that a simple AI-interaction notice does not stop users from over-trusting confidently worded but unverified chatbot output — disclosure alone does not compel verification behaviour, which matters directly for research assistants summarising literature.

    Are AI systems built only for research exempt from Article 50?

    Only narrowly. Recital 25 exempts AI developed solely for scientific research and development as the object of study. It does not exempt a research office’s use of commercial, off-the-shelf AI tools — those deployments remain subject to Article 50 in the same way as any other organisation’s use.

    What this means for research offices

    Research administration teams procuring or building AI tools should treat 2 August 2026 as the operative date for every disclosure duty except machine-readable marking of pre-existing generative systems. Practical steps:

    • Inventory every AI tool used in research workflows — literature review, participant engagement, lab generation, public communications — and tag each against Articles 50(1)–50(4).
    • Confirm vendor contracts assign responsibility: does the vendor act as provider, leaving the institution as deployer with its own disclosure duties?
    • Check chatbot and assistant interfaces disclose AI involvement clearly at first use, not buried in terms and conditions.
    • Do not treat the December 2026 marking grace period as covering anything beyond Article 50(2) technical marking of pre-existing systems.
    • Review public-facing AI-drafted content (news releases, dissemination summaries) for the human-review and editorial-responsibility carve-out under Article 50(4).

    Institutions with dedicated research administration functions are well placed to run this audit alongside existing research-integrity and data-governance processes, since the same tool inventory typically maps onto GDPR and funder AI-use disclosure requirements already in place.

    What happens next

    The Commission’s final Guidelines and the finalised Code of Practice are both due before 2 August 2026, and both will refine — not delay — the duties above. Offices waiting for the Code before acting on Article 50(1), (3) and (4) will miss the window, since the Code covers marking and labelling detail only, not the underlying legal duty to disclose. Institutions best placed by August will have already mapped their AI tool inventory against Article 50, rather than treating the whole article as paused.