The Negative of the Negative › entity data-provenance-initiative

One entity of the Negative of the Negative (EA-NEGONT-02, #1690), cited at https://www.alexanarch.org/non/data-provenance-initiative/. the table of contents · this entity as data · contents as data · the dataset on the Hub · row json · field ledger · archive ledger · D/R/O traversal · the address page · the provenance meta-aggregator record.

A reader that fetches this page may stop short of its end; the entry's text, every sentence of its knowledge object with the claims it cites and each claim's quote, source and locus, is in entity.json beside it.

Data Provenance Initiative

SPXI instrument · method 0.16 of 87, level 0 (Measurement): The Negative of the Negative (/non). An instrument of SPXI, the Semantic Packet for eXchange & Indexing; the whole practice is itemized at spxi.dev/methods.

type C — a conventional reading holds it (public entity on which the archive bears: a research initiative with its audit collection, explorer and card; an entity of the provenance meta-aggregator) · sought at Data Provenance Initiative

composed 2026-10-29 under EA-NEGONT-02 v0.9, #1690, equal case, ρ = extends (draft, not frozen; ledgers unaudited, one extractor; checked by the session and the page builder)

AXN AXN:0ADB.NON.💎🪞🌓🐝◀️⏏️ · root AXN:0ADB.NON

composed in session · Claude (Opus 5.5), subagent, 2026-10-29

This row was composed in session. SPXI-gnΩsis (gnosis.spxi.dev) opens a Wikipedia revision sentence by sentence against the sources it cites; a commission consults the archive by its own procedure and composes the entity's row here; a quote to recompose this entity is free.

Google AI Overview (expanded)epoch 2026-10-29
not frozentype C — a conventional reading holds it (public entity on which the archive bears: a research initiative with its audit collection, explorer and card; an entity of the provenance meta-aggregator)signed out, incognitoknowledge object · 27 sentences

EA-NEGONT-02 v0.9, #1690: equal case, ρ = extends, read from the provenance census record, the capture record and #725's statement of relation; archive selected by D/R/O (10 deposits admitted by reading, 6 with claims and 4 grouped as instances; hop of 73 read and rejected), with the provenance census record (22 claims) and the Capture Registry's findings and analysis (13 claims) ledgered as the archive's records of the entity; the field B by origin (4 cards, 2 own pages, 0 census third-party, 1 Wikipedia title); the composer read the ledgers, never the transcript, except where the brief asks for T's claims and the delta. Ledger: unaudited (§3.8: one extractor per ledger); field quotes 47/47 verified by script against saved text (the bundle's extracted page text for B1 and B7, the census's copy for B5, the Wikipedia responses for B6); archive quotes 63/63 verified against the registry entry, census.json and the deposit texts; CAP-1-01 carried with the mark contradicts_primary.

WORKING KNOWLEDGE OBJECT · NOT FROZEN · LEDGER UNAUDITED

Current instantiation — composed under EA-NEGONT-02 v0.9 (#1690)

Compression · Field and archive, equal terms — L(B ∪ A)Data Provenance Initiative

Data Provenance Initiative is a volunteer collective of AI researchers auditing AI training data: 1,800+ text datasets in its 2023 first release, now four public measurement systems from datasets and web consent to model markets and real use (its pages); the archive sets it in the licensing dimension of provenance, bounded at the corpus (#725).

🗂️ What it is

  • Operator: a "volunteer effort"; paper by Longpre and 16 others (README; arXiv; census); MIT researchers among its founders (MIT Sloan).3↘
    The Data Provenance Initiative is, in its repository's words, "a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI," and on its About page "a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI" (README; dataprovenance.org/about); the provenance census record gives its operator as the Initiative itself, a "volunteer effort" with a "paper by Shayne Longpre and 16 other authors," kinds it an "audit collection and explorer" and sets it in the lineage of "training data" (provenance census record).§1 MIT Sloan's account has "a team of multidisciplinary researchers, including professor Sandy Pentland and others from MIT," create the Initiative "to tackle the data transparency challenge head-on" (MIT Sloan, 3 March 2025), and the home page says that "DPI releases papers, datasets, and dashboards that help researchers, journalists, policymakers, and builders reason from shared evidence" (dataprovenance.org).§2 The founding paper was submitted on 25 October 2023 and revised on 4 November 2023, "by Shayne Longpre and 16 other authors" (arXiv:2310.16787), and published in Nature Machine Intelligence, volume 6, on 30 August 2024 (Nature Machine Intelligence); the census dates the entity from the preprint, "2023 (arXiv:2310.16787, v1 25 October 2023)" (provenance census record).§7
  • Data provenance: a dataset's "sourcing, creation and licensing heritage" (Nature MI), traced to source, creators, licences, use (arXiv; census).2↘
    The founding audit's authors name its object: "we term the combination of these indicators, including a dataset's sourcing, creation and licensing heritage, as well as its characteristics, the 'data provenance'" (Nature Machine Intelligence, 30 August 2024), traced "from their source, creators, series of license conditions, properties, and subsequent use" (arXiv:2310.16787), and the home page's "Training Data Provenance" traces "the sources, licenses, creators, languages, geographies, and derivation chains behind public AI training datasets" (dataprovenance.org).§4 The provenance census asks of each entity it formalizes "What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?" and answers for the Initiative that it records, of the three capabilities express, record and test: its object "a fine-tuning dataset, traced through its collection to its sources," its unit "a dataset within a collection," its relations derivation, creators, licences and subsequent use, the last field restating the paper's lineage (provenance census record).§5
  • Its dimension: training-corpus licensing: "Under what permissions did this data enter this system?" (#725).1↘
    #725 sets that object in the second dimension of provenance, "training-corpus licensing," which "has academic instrumentation and emerging legal architecture," its object "The corpus" and its question "Under what permissions did this data enter this system?", with the Initiative among its frameworks and among provenance's disciplinary homes as "dataset documentation (DPI, model cards, dataset cards)," and states that the dimensions of artifact, licensing and meaning are independent: "a licensed dataset can produce outputs with excellent semantic provenance if the synthesis preserves attribution" (#725).§6

🧾 Origin and extent

  • Founding audit: 1800+ text datasets, 25 Oct 2023 (arXiv); 1,858 in 44 collections (Nature MI, 2024).3↘
    The founding paper was submitted on 25 October 2023 and revised on 4 November 2023, "by Shayne Longpre and 16 other authors" (arXiv:2310.16787), and published in Nature Machine Intelligence, volume 6, on 30 August 2024 (Nature Machine Intelligence); the census dates the entity from the preprint, "2023 (arXiv:2310.16787, v1 25 October 2023)" (provenance census record).§7 It convened "a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets" (arXiv), in the journal "44 instruction or 'alignment' finetuning data collections composed of 1,858 individual datasets" (Nature Machine Intelligence), the release the repository calls the Data Provenance Collection and "this initiative's first release" (README), and the count the census carries, "44 data collections, 1800+ fine-tuning text-to-text datasets (first release)," as of the README (provenance census record); MIT Sloan gives "more than 1,800 text datasets" from "44 of the most widely used text data collections" (MIT Sloan).§8 The journal gives the measure by platform, "more than 70% of licences for popular datasets on GitHub and Hugging Face are 'unspecified'" and "66% of analysed Hugging Face licences were in a different use category, often labelled as more permissive than the author's original licence," and names "a crisis in licence laundering" (Nature Machine Intelligence); MIT Sloan restates error rates "greater than 50%" and omission rates "of more than 70%" (MIT Sloan).§15
  • Tools: Explorer, Collection and Card, "symbolic attribution for all constituent datasets" (README).2↘
    With the audit came "an interactive UI, the Data Provenance Explorer, which allows practitioners to trace and filter on data provenance for the most popular open source finetuning data collections" (arXiv), in the journal "an open-source repository for downloading, filtering and exploring data provenance and characteristics" whose tools "auto-generate data provenance cards for scalable symbolic attribution" (Nature Machine Intelligence); the repository's Data Provenance Card is "symbolic attribution for all constituent datasets, that can be used as structured documentation" (README), "human-readable" in MIT Sloan's account (MIT Sloan), and the census carries it as the entity's provenance carrier beside "audit metadata per dataset" (provenance census record).§9 The census gives Data Provenance Explorer, Data Provenance Collection and Data Provenance Card as other names of the entity and states its relation to them twice: among its negative tags, "initiative, explorer and collection are distinct records," and on its sibling relation to the MMRS meta-aggregator's record of the explorer, "the same entity, read for reception there and for provenance carriage here"; it records the Explorer as "a JavaScript application, unreadable to a plain fetch" (provenance census record).§10
  • Now: 4,000+ datasets audited, 14,000 web domains tracked, 851k open models, 23,158 conversations (home page).3↘
    Its work, the About page says, "began with training data provenance: tracing datasets from origin to creation, cataloging sources, licenses, creators, and documentation practices" and "now also covers web consent, open model markets, concentration of power, and how people use AI systems in practice" (dataprovenance.org/about); the home page calls it "Public measurement infrastructure for AI data, model ecosystems, and real-world AI use," which "maps the datasets, web policies, model markets, and real-world AI uses that shape how AI systems are built and governed" through "Four public measurement systems" (dataprovenance.org).§3 The home page's four systems are the Data Provenance Explorer ("4,000+ datasets," "608 languages across text, speech, and video," inspecting "dataset sources, licenses, creators, geographies, modalities, and derivation chains"), the Web Consent Explorer ("14,000 domains," "Terms, robots.txt, and crawl restrictions"), Open Model Evolution ("851k open models," "2.2B downloads") and The AI Observatory ("23,158 conversations," "85,633 turns from 7 public sources") (dataprovenance.org).§11 Its metrics read "4,000+" "datasets audited," "14,000" "web domains tracked," "851k" "open models measured" and "23,158" "AI conversations annotated," and its publications carry the later work: Consent in Crisis (NeurIPS 2024), the multimodal audit, "An audit of four thousand public text, speech, and video datasets" (ICLR 2025), Economies of Open Intelligence (preprint) and The AI Observatory (NeurIPS 2026) (dataprovenance.org); in March 2025 MIT Sloan still had the work "currently focused on the data provenance of text," with a plan "to expand to other media, such as video" (MIT Sloan).§12
  • Later audits: Consent in Crisis (NeurIPS 2024); four thousand text, speech and video datasets (ICLR 2025).1↘
    Its metrics read "4,000+" "datasets audited," "14,000" "web domains tracked," "851k" "open models measured" and "23,158" "AI conversations annotated," and its publications carry the later work: Consent in Crisis (NeurIPS 2024), the multimodal audit, "An audit of four thousand public text, speech, and video datasets" (ICLR 2025), Economies of Open Intelligence (preprint) and The AI Observatory (NeurIPS 2026) (dataprovenance.org); in March 2025 MIT Sloan still had the work "currently focused on the data provenance of text," with a plan "to expand to other media, such as video" (MIT Sloan).§12
  • The record: the census keeps the first release's count, the composition "ahead of the record" (Capture Registry).1↘
    The census carries the entity as "active" and lists "the Explorer itself (JavaScript)" and "the multimodal extension (arXiv:2412.17847)" among what it has not yet checked (provenance census record); the Capture Registry finds that "The record has one explorer and the first release's count," that the home-page card gives "four platforms and '4,000+ audited datasets; 14,000 tracked web domains'," that the composition is "ahead of the record on the entity's current extent," and that "The census is to re-read dataprovenance.org and carry the platforms and the current count with their quotes," the capture being "a correction to be made from the entity's own page" (Capture Registry, 2026-10-29).§13
  • One record or three: "distinct records", and "the same entity" as the explorer's MMRS record (census).1↘
    The census gives Data Provenance Explorer, Data Provenance Collection and Data Provenance Card as other names of the entity and states its relation to them twice: among its negative tags, "initiative, explorer and collection are distinct records," and on its sibling relation to the MMRS meta-aggregator's record of the explorer, "the same entity, read for reception there and for provenance carriage here"; it records the Explorer as "a JavaScript application, unreadable to a plain fetch" (provenance census record).§10

🔎 Findings

  • Licences: omission 70%+, errors 50%+ on hosting sites (arXiv); 66% of Hugging Face licences recategorized (Nature MI).5↘
    It convened "a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets" (arXiv), in the journal "44 instruction or 'alignment' finetuning data collections composed of 1,858 individual datasets" (Nature Machine Intelligence), the release the repository calls the Data Provenance Collection and "this initiative's first release" (README), and the count the census carries, "44 data collections, 1800+ fine-tuning text-to-text datasets (first release)," as of the README (provenance census record); MIT Sloan gives "more than 1,800 text datasets" from "44 of the most widely used text data collections" (MIT Sloan).§8 The founding audit observed "frequent miscategorization of licenses on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+," which "points to a crisis in misattribution and informed use of the most popular datasets driving many recent breakthroughs" (arXiv), the result the census records as what survived the operation it tested, "dataset repackaging and hosting (licence carried or lost on hosting sites)" (provenance census record).§14 The journal gives the measure by platform, "more than 70% of licences for popular datasets on GitHub and Hugging Face are 'unspecified'" and "66% of analysed Hugging Face licences were in a different use category, often labelled as more permissive than the author's original licence," and names "a crisis in licence laundering" (Nature Machine Intelligence); MIT Sloan restates error rates "greater than 50%" and omission rates "of more than 70%" (MIT Sloan).§15 The Capture Registry checked these figures "against the provenance census record of the same day and the entity pages it saved" and calls the 70%/50% wording "the record's quote from the repository README" (Capture Registry, 2026-10-29), where the census gives it as what "the founding paper reports" (provenance census record).§16 "In total, 85% of dataset licences request attribution, and 30% include a share-alike clause" (Nature Machine Intelligence); #725 carries these figures with the omission and error rates and reads them as the licensing dimension's ground, "The DPI's documentation of 70%+ license-omission rates establishes the licensing dimension's urgency" (#725), and #1714 reads the finding as "how much is lost before training even begins" (#1714).§17
  • Attribution: 85% of licences request it, 30% share-alike (Nature MI; #725).1↘
    "In total, 85% of dataset licences request attribution, and 30% include a share-alike clause" (Nature Machine Intelligence); #725 carries these figures with the omission and error rates and reads them as the licensing dimension's ground, "The DPI's documentation of 70%+ license-omission rates establishes the licensing dimension's urgency" (#725), and #1714 reads the finding as "how much is lost before training even begins" (#1714).§17
  • Divide: closed datasets hold lower-resource languages and creative tasks (arXiv); non-commercial licences 61% in 2023 (Nature MI).1↘
    Of the commercial divide the preprint finds "closed datasets monopolizing important categories: lower resource languages, more creative tasks, richer topic variety, newer and more synthetic training data" (arXiv); the journal records that "In 2023 there was a spike in NC/A-O dataset licences," "the NC/A-O rate is 61%" that year, and that "a full 45% of NC/A-O datasets are synthetic, compared to <14% in more permissive licence categories" (Nature Machine Intelligence); the home page's findings are "Source content often carries stricter terms than dataset releases," "Open weights now outpace truly open-source models" and "No single public conversation source generalizes across AI use" (dataprovenance.org).§18
  • Skew: Western-centric (Nature MI; MIT Sloan).1↘
    The journal finds "a stark Western-centric skew in representation" (Nature Machine Intelligence), MIT Sloan language "heavily skewed toward English and Western European languages," and MIT Sloan states the stake: without lineage, users "may find themselves out of compliance with emerging regulations like the European Union's AI Act or exposed to legal and copyright risks" (MIT Sloan).§19

⚖️ Limits and bound

  • Limits: not legal advice; self-reported licences (README; Nature MI; About); a collection does not show which model used it (census).1↘
    Its stated limits: "any output of the Data Provenance Initiative does not, and is not intended to, constitute legal advice" (README); the licence protocol "reflects best efforts to verify self-reported licences and does not constitute legal advice" (Nature Machine Intelligence); "We collect self-reported licenses from the papers and repositories that released these datasets and categorize them according to our best efforts" (dataprovenance.org/about); the census tags it "NOT legal advice (its own notice)" and adds that "describing a collection does not establish which model used it" (provenance census record), and the Capture Registry finds both tags "not composed" at the name (Capture Registry, 2026-10-29).§20
  • Bound: "audits whether datasets were licensed, not whether synthesized outputs preserve attribution" (#725).2↘
    #725 states the bound in its canonical claim, that existing frameworks "address the artifact (C2PA / Content Credentials) and the corpus (Data Provenance Initiative, EU AI Act transparency provisions, W3C PROV)" and "are not designed to address the survival of authorial lineage through AI synthesis": the Initiative "audits whether datasets were licensed, not whether synthesized outputs preserve attribution to the human sources whose labor the synthesis depended upon," stands at "Layer 2 (licensing)," "Necessary but operates on corpus, not synthesis output," and licensing provenance "operates at corpus-ingestion stage" (#725).§21 "Licensing audits operate on the input to AI systems. They do not address the output" (#725, emphasis dropped): "The Data Provenance Initiative tells you whether the dataset was licensed," and none of the instruments "was designed to tell you what happened to the meaning between the camera and the screen, between the dataset and the answer"; the path from the Initiative runs through "dataset licensing" to "what about what the model produces from the licensed data?" and so to semantic provenance, which extends provenance "to the lifecycle of the meaning the content carries," with the Initiative as "layer 2 of" provenance after AI (#725).§22
  • Held beside: studies of "attribution loss in AI outputs" (#1003).1↘
    #1003 groups the Initiative with C2PA and W3C PROV as "Provenance and attribution studies" that "have focused on attribution loss in AI outputs" (#1003), a reading composed beside #725's bound at the input.§23
  • Layer: "Documentation project, not infrastructure"; L4; its schema "Implemented (in CHA)" (#98).1↘
    #98 tables the Initiative (MIT) as documenting "provenance of popular AI training datasets," a "Documentation project, not infrastructure," and Consent in Crisis as a "Diagnostic paper," in the pattern "They diagnose the crisis or build narrow fixes"; it sets the Initiative at "L4: Provenance / Consent," where what is missing is "Integrated provenance in training pipeline," and records the archive's own provenance schema as taken from it, "Implemented (in CHA)" (#98).§24
  • Pipeline: "Provenance has to survive the training pipeline" (#1714; #95; #623).1↘
    #1714 draws the requirement, "Provenance has to survive the training pipeline," and "Sources can be recorded at ingestion, the record kept with the training set," with the Initiative's literature bearing "on whether slushing is a fixed property of pipelines" (#1714); #95 names "training-data provenance records" among the companion infrastructure for parametric claims, which PER reaches "only indirectly" (#95), and #623 calls standardized documentation of training-data provenance "a step toward the accounting the framework demands" (#623).§25

📰 Reception

  • Press: major press (home page); no Wikipedia article; DPI papers predicted for broad queries (#725).1↘
    The home page lists coverage by "the Financial Times, The New York Times, The Washington Post, MIT Technology Review, IEEE Spectrum, and VentureBeat" and citation in "public AI safety and governance reporting" (dataprovenance.org); Wikipedia has no article on it (Wikipedia, 2026-10-29); #725 predicted that broad queries "will be dominated by C2PA/CAI publications, DPI papers, and major media for the foreseeable future" (#725).§26
  • Overview: operator from the MIT Sloan card; no author; no card cites the record (Capture Registry).1↘
    At the bare name on Google's AI Overview the Capture Registry reads the composition first as identifying "the project," listing "its tools" and reporting "what its audits found, from its own site, its paper and the press," then finds that its "'multi-institutional research project—led in part by researchers from MIT'" "follows the MIT Sloan card," that "the composition names no one" ("MIT named; no person; no identifier"), and that "no card cites" the census record, which "landed on provenanceerasure.org the same day" (Capture Registry, 2026-10-29).§27
1what it is: a volunteer collective auditing AI dataMIT Sloan — Bringing transparency to the data used to train artificial intelligence7 claims · B1, B3, B5, B7, provenance-census
  • F40 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    The Data Provenance Initiative is a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI.
  • F45 Data Provenance Initiative — About, /about (xh): ¶1 documented · field
    We are a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI.
  • PE-02 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], operator documented
    the Data Provenance Initiative (volunteer effort; paper by Shayne Longpre and 16 other authors)
  • PE-04 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], kind stipulation
    audit collection and explorer
  • PE-03 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], lineage stipulation
    training data
  • F23 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body ¶4 documented · field
    A team of multidisciplinary researchers, including professor Sandy Pentland and others from MIT, created the Data Provenance Initiative to tackle the data transparency challenge head-on.
  • F9 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Public-interest infrastructure' documented · field
    DPI releases papers, datasets, and dashboards that help researchers, journalists, policymakers, and builders reason from shared evidence.
2its extent now: public measurement infrastructure for AI data, models and useData Provenance Initiative — About4 claims · B1, B7
  • F46 Data Provenance Initiative — About, /about (xh): ¶1 documented · field
    Our work began with training data provenance: tracing datasets from origin to creation, cataloging sources, licenses, creators, and documentation practices. It now also covers web consent, open model markets, concentration of power, and how people use AI systems in practice.
  • F1 Data Provenance Initiative — Data Provenance Initiative (home), served HTML: meta description documented · field
    Public measurement infrastructure for AI data, model ecosystems, and real-world AI use.
  • F2 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): hero documented · field
    Public evidence for accountable AI … DPI maps the datasets, web policies, model markets, and real-world AI uses that shape how AI systems are built and governed.
  • F3 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Flagship systems' documented · field
    Four public measurement systems … Together they trace AI from source data and web consent to model markets and real-world use.
3the term: data provenance, its relations and its unitarXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI12 claims · #725, B1, B2, B4, provenance-census
  • F30 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶3 documented · field
    In this work, we term the combination of these indicators, including a dataset’s sourcing, creation and licensing heritage, as well as its characteristics, the ‘data provenance’.
  • F18 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    We develop tools and standards to trace the lineage of these datasets, from their source, creators, series of license conditions, properties, and subsequent use.
  • F15 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Training Data Provenance' documented · field
    Training Data Provenance … Dataset audits … Trace the sources, licenses, creators, languages, geographies, and derivation chains behind public AI training datasets.
  • PE-22 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json organizing_question stipulation
    What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?
  • PE-05 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], capability stipulation
    records
  • PE-06 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], provenance_object stipulation
    a fine-tuning dataset, traced through its collection to its sources
  • PE-09 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], unit stipulation
    a dataset within a collection
  • PE-07 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], relation_types documented
    derivation (source and lineage) … creators … licences … subsequent use
  • O725-03 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §0 ¶ 'The second dimension — training-corpus licensing' stipulation
    The second dimension — **training-corpus licensing** — has academic instrumentation and emerging legal architecture.
  • O725-05 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · Central Invariant, table row 'Licensing' stipulation
    | **Licensing** | The corpus | Under what permissions did this data enter this system? | Data Provenance Initiative, EU AI Act, W3C PROV |
  • O725-15 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §1.1 Provenance — the established discourse, the list of disciplinary homes stipulation
    dataset documentation (DPI, model cards, dataset cards)
  • O725-06 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · Central Invariant, ¶ after the table stipulation
    The dimensions are independent: a C2PA-signed image can carry meaning whose lineage has been eroded; a licensed dataset can produce outputs with excellent semantic provenance if the synthesis preserves attribution; an unlicensed dataset can produce outputs that nonetheless cite their sources clearly.
4the founding audit: 44 collections, 1,800+ text datasets (2023)arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI7 claims · B2, B4, B5, provenance-census
  • F16 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, abstract page header documented · field
    [Submitted on 25 Oct 2023 (v1), last revised 4 Nov 2023 (this version, v3)] … The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI … by Shayne Longpre and 16 other authors
  • F29 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, article header documented · field
    Published: 30 August 2024 … Nature Machine Intelligence … volume 6, pages 975–987 (2024)
  • PE-15 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], founded documented
    2023 (arXiv:2310.16787, v1 25 October 2023)
  • F17 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    we convene a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets.
  • F31 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶6 documented · field
    As a first contribution of the initiative, we audit 44 instruction or ‘alignment’ finetuning data collections composed of 1,858 individual datasets
  • F41 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    Through a large scale audit of 44 data collections, spanning 1800+ finetuning text-to-text datasets, referred to as the Data Provenance Collection, this initiative's first release thoroughly documents their web and machine sources, licenses, creators, and other metadata.
  • PE-10 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], count documented
    44 data collections, 1800+ fine-tuning text-to-text datasets (first release) … the repository README
5the Explorer, the Collection and the CardarXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI9 claims · B2, B3, B4, B5, provenance-census
  • F22 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    we release our entire audit, with an interactive UI, the Data Provenance Explorer, which allows practitioners to trace and filter on data provenance for the most popular open source finetuning data collections
  • F34 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, contributions, second documented · field
    The Data Provenance Explorer (DPExplorer) (www.dataprovenance.org), an open-source repository for downloading, filtering and exploring data provenance and characteristics. Our tools auto-generate data provenance cards for scalable symbolic attribution and future documentation best practices.
  • F42 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    Generating a subset of data from this repository will create a `Data Provenance Card`---symbolic attribution for all constituent datasets, that can be used as structured documentation.
  • F25 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'two key actions', second documented · field
    Practitioners can also use the tool to generate a human-readable data provenance card for datasets
  • PE-08 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], provenance_carrier documented
    audit metadata per dataset; a Data Provenance Card generated for a chosen subset
  • PE-01 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], aka stipulation
    Data Provenance Explorer … Data Provenance Collection … Data Provenance Card
  • PE-18 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], negative_tags[2] stipulation
    initiative, explorer and collection are distinct records
  • PE-19 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], relations[0].note stipulation
    the same entity, read for reception there and for provenance carriage here
  • PE-13 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], data_access documented
    repository scripts to filter and download; the Explorer (a JavaScript application, unreadable to a plain fetch)
6the four systems and their countsData Provenance Initiative — Data Provenance Initiative (home)12 claims · B1, capture-registry, provenance-census
  • F4 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Data Provenance Explorer' (constant xr) documented · field
    Data Provenance Explorer … Training data … 4,000+ datasets … 608 languages across text, speech, and video … Inspect dataset sources, licenses, creators, geographies, modalities, and derivation chains.
  • F5 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Web Consent Explorer' documented · field
    Web Consent Explorer … Web data … 14,000 domains … Terms, robots.txt, and crawl restrictions … Track how web consent signals are changing as AI developers compete for training data.
  • F6 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Open Model Evolution' documented · field
    Open Model Evolution … Model ecosystem … 851k open models … 2.2B downloads and 200+ model attributes … Monitor concentration, participation, transparency, and technical shifts in open-weight AI.
  • F7 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'The AI Observatory' documented · field
    The AI Observatory … Real-world use … 23,158 conversations … 85,633 turns from 7 public sources … Compare how people use and misuse AI systems across sources, models, and contexts.
  • F8 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): metrics strip (constant br) documented · field
    4,000+ … datasets audited … 14,000 … web domains tracked … 851k … open models measured … 23,158 … AI conversations annotated
  • PE-14 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], lifecycle.state documented
    active
  • PE-20 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], unchecked self-description
    the Explorer itself (JavaScript) … the multimodal extension (arXiv:2412.17847) … data licence of the audit
  • CAP-1-05 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[2] s2 documented
    The record has one explorer and the first release's count (44 collections, 1,800+ datasets).
  • CAP-1-06 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[2] s3 documented
    The home-page card gives four platforms and '4,000+ audited datasets; 14,000 tracked web domains'.
  • CAP-1-10 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, analysis s1 interpretation
    As with the revived Papers with Code on the MMRS side, the composition is ahead of the record on the entity's current extent: the census formalized the initiative from its first release and its repository, and the Overview read its present home page.
  • CAP-1-07 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[2] s4 stipulation
    The census is to re-read dataprovenance.org and carry the platforms and the current count with their quotes; until then the card's figures are unchecked.
  • CAP-1-11 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, analysis s2 interpretation
    The capture is a correction to be made from the entity's own page.
7the later audits: consent, multimodal, models, useMIT Sloan — Bringing transparency to the data used to train artificial intelligence4 claims · B1, B3
  • F11 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, 'Consent in Crisis' documented · field
    Consent in Crisis: The Rapid Decline of the AI Data Commons … An audit of terms, restrictions, and consent signals across the web. … NeurIPS 2024
  • F12 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, the multimodal audit documented · field
    Bridging the Data Provenance Gap Across Text, Speech, and Video … An audit of four thousand public text, speech, and video datasets. … ICLR 2025
  • F13 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, the model economy and real-world use documented · field
    The AI Observatory: A Public Measure of Real-World AI Use … NeurIPS 2026 … Economies of Open Intelligence: Tracing Power and Participation in the Model Ecosystem … Preprint
  • F28 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body, closing ¶ before the quote documented · field
    While the group’s efforts are currently focused on the data provenance of text, the plan is to expand to other media, such as video, as well as domain-specific data
8audit findings: licence omission and error on hosting sitesarXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI13 claims · #1714, #725, B2, B3, B4, capture-registry, provenance-census
  • F24 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'two key actions', first documented · field
    Conducted a systematic audit of more than 1,800 text datasets. The researchers traced the lineage of fine-tuning datasets from 44 of the most widely used text data collections. They found that licenses were frequently miscategorized, with error rates greater than 50% and license information omission rates of more than 70%.
  • F20 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    We also observe frequent miscategorization of licenses on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+.
  • F21 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    This points to a crisis in misattribution and informed use of the most popular datasets driving many recent breakthroughs.
  • PE-12 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], retention_results documented
    the founding paper reports licence omission of 70%+ and error rates of 50%+ on widely used hosting sites
  • PE-11 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], transformations_tested documented
    dataset repackaging and hosting (licence carried or lost on hosting sites)
  • PE-21 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], evidence.finding.quote attributed
    This points to a crisis in misattribution and informed use of the most popular datasets
  • F32 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶5 documented · field
    Notably, we find that more than 70% of licences for popular datasets on GitHub and Hugging Face are ‘unspecified’ … our rigorous re-annotation of licences finds that 66% of analysed Hugging Face licences were in a different use category, often labelled as more permissive than the author’s original licence.
  • F33 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶5 documented · field
    Our work highlights a crisis in licence laundering and informed usage of popular datasets
  • CAP-1-02 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[0] s3 documented
    Checked 2026-10-29 against the provenance census record of the same day and the entity pages it saved.
  • CAP-1-01 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[0] s2 documented
    'license omission of 70%+ and error rates of 50%+' is the record's quote from the repository README.
  • D725-02 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §0 ¶ 'The second dimension — training-corpus licensing' attributed
    The Data Provenance Initiative (Longpre et al., Nature Machine Intelligence 2024) audited 1,800+ datasets, finding that 85% of licenses request attribution and 30% include share-alike clauses, with license omission rates above 70% and error rates above 50% on popular hosting sites.
  • D725-16 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §3.2 Correction s5 stipulation
    The DPI's documentation of 70%+ license-omission rates establishes the licensing dimension's urgency; semantic provenance addresses the dimension that follows.
  • D1714-01 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · §9.2 s3 attributed
    The audit literature shows how much is lost before training even begins: the Data Provenance Initiative found license information missing for more than 70% of widely used datasets on the major hosting sites and mislabeled for more than half (Longpre et al. 2023).
9audit findings: attribution and share-alike requestedNature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI1 claim · B4
  • F35 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, licence findings documented · field
    In total, 85% of dataset licences request attribution, and 30% include a share-alike clause
10audit findings: the commercial divide, the non-commercial spike, synthetic dataarXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI4 claims · B1, B2, B4
  • F19 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    Our landscape analysis highlights the sharp divides in composition and focus of commercially open vs closed datasets, with closed datasets monopolizing important categories: lower resource languages, more creative tasks, richer topic variety, newer and more synthetic training data.
  • F36 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, 'In 2023 there was a spike in NC/A-O dataset licences' documented · field
    In 2023 there was a spike in NC/A-O dataset licences … in 2023, when many of the most popular and diverse datasets were published, the NC/A-O rate is 61%.
  • F37 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, licence-category comparison documented · field
    Table 3 also shows a full 45% of NC/A-O datasets are synthetic, compared to <14% in more permissive licence categories.
  • F14 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): findings strip documented · field
    Data transparency … Open weights now outpace truly open-source models … Dataset restrictions … Source content often carries stricter terms than dataset releases … Real-use heterogeneity … No single public conversation source generalizes across AI use
11audit findings: the language and Western skewNature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI2 claims · B3, B4
  • F38 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, 'Language representation is heavily skewed …' documented · field
    we find a stark Western-centric skew in representation.
  • F27 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'other issues', second documented · field
    Language used in the datasets is heavily skewed toward English and Western European languages, with sparse coverage of languages from Asian, African, and South American nations, if at all.
12the risks it addressesMIT Sloan — Bringing transparency to the data used to train artificial intelligence1 claim · B3
  • F26 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body ¶2 documented · field
    Without transparency into the lineage of data used for artificial intelligence models, researchers, businesses, and other intended users may find themselves out of compliance with emerging regulations like the European Union’s AI Act or exposed to legal and copyright risks.
13stated limits: not legal advice; self-reported licencesNature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI6 claims · B4, B5, B7, capture-registry, provenance-census
  • F43 Data Provenance Initiative — Data-Provenance-Collection README, 'Legal Notice and Limitations' documented · field
    The information provided on this page and any output of the Data Provenance Initiative does not, and is not intended to, constitute legal advice; instead, all information, content, and materials are for general informational purposes only.
  • F39 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Methods, 'Licence annotation process' documented · field
    Note that this protocol reflects best efforts to verify self-reported licences and does not constitute legal advice.
  • F47 Data Provenance Initiative — About, /about: note documented · field
    We collect self-reported licenses from the papers and repositories that released these datasets and categorize them according to our best efforts as a volunteer research and transparency initiative. Information provided by our work and outputs of the Data Provenance Initiative does not constitute legal advice
  • PE-16 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], negative_tags[0] documented
    NOT legal advice (its own notice)
  • PE-17 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], negative_tags[1] stipulation
    describing a collection does not establish which model used it
  • CAP-1-08 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[3] s2 documented
    'NOT legal advice' and 'describing a collection does not establish which model used it' are not composed; the composition does not claim otherwise.
14its bound: the corpus, not the output#725 Provenance After AI Metadata Packet for Disambiguation: From Artifact · 2026-05-0810 claims · #1003, #725
  • D725-01 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · Canonical Claim stipulation
    Existing provenance frameworks address the artifact (C2PA / Content Credentials) and the corpus (Data Provenance Initiative, EU AI Act transparency provisions, W3C PROV). They are not designed to address the survival of authorial lineage through AI synthesis.
  • D725-04 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §0 ¶ 'Existing frameworks are not designed to detect this' stipulation
    The Data Provenance Initiative audits whether datasets were licensed, not whether synthesized outputs preserve attribution to the human sources whose labor the synthesis depended upon.
  • D725-10 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §4 Disambiguation Matrix, row 'Data Provenance Initiative (DPI)' stipulation
    | Data Provenance Initiative (DPI) | Academic audit of training-dataset licenses | Layer 2 (licensing) | Necessary but operates on corpus, not synthesis output |
  • O725-11 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §1.4 The Three Dimensions ¶2 stipulation
    Licensing provenance (DPI, EU AI Act Article 50, Recitals 105-106, Article 53 opt-out signaling, W3C PROV) audits whether *this dataset* was used with *this permission* under *this license*. It is necessary but operates at corpus-ingestion stage.
  • D725-08 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §3.2 Misreading: provenance as licensing-only, Correction s1–4 stipulation
    Licensing audits operate on the *input* to AI systems. They do not address the *output*. A model trained on properly licensed scholarship can still produce outputs that erase the scholarship's lineage. Licensing provenance and semantic provenance are different problems requiring different instruments.
  • D725-09 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §11 Closing Claim ¶1 stipulation
    The Data Provenance Initiative tells you whether the dataset was licensed. EU AI Act transparency provisions tell you whether the content was AI-generated. None of these instruments was designed to tell you what happened to the meaning between the camera and the screen, between the dataset and the answer, between the source and the synthesis.
  • R725-12 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §5.1 Inward paths, third stipulation
    Data Provenance Initiative → dataset licensing → **what about what the model produces from the licensed data?** → **semantic provenance**
  • O725-07 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §0 ¶ 'Semantic provenance names the dimension' stipulation
    **Semantic provenance** names the dimension that completes the C2PA ambition of trust in digital content by extending provenance from the moment of creation to the lifecycle of the meaning the content carries.
  • R725-13 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §7 Canonical Edge Table, row 'DPI / EU AI Act Article 50' stipulation
    | DPI / EU AI Act Article 50 | is layer 2 of | provenance after AI | Locates licensing/disclosure |
  • D1003-01 #1003 AI-Native Intellectual Biography: Genre, Provenance, and the Archive That Outpaced Its Author Description (as recorded b Sharks, Lee · 2026-05-21 · ¶ 'Provenance and attribution studies' stipulation
    **Provenance and attribution studies** in digital environments — C2PA, the Data Provenance Initiative, W3C PROV — have focused on attribution loss in AI outputs.
15documentation, not infrastructure; the archive's adoption#98 Distributed Compute Is Not Distributed Intelligence: A Competitive Ana · 2026-05-075 claims · #98
  • D98-01 #98 Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic Lee Sharks · 2026-05-07 · § D. Data Provenance and Consent, table row 1 stipulation
    | Data Provenance Initiative (MIT) | Documents provenance of popular AI training datasets | Documentation project, not infrastructure |
  • D98-02 #98 Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic Lee Sharks · 2026-05-07 · § D. Data Provenance and Consent, table row 2 stipulation
    | "Consent in Crisis" (Longpre et al., 2024) | Audit of C4, RefinedWeb, Dolma; documents collapse of web-consent infrastructure | Diagnostic paper |
  • D98-05 #98 Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic Lee Sharks · 2026-05-07 · § D. Data Provenance and Consent, 'Pattern' stipulation
    Pattern: They diagnose the crisis or build narrow fixes. None build general infrastructure for *contribution as participation in collective intelligence*.
  • O98-03 #98 Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic Lee Sharks · 2026-05-07 · The Stack, the layer table, row L4 stipulation
    | L4: Provenance / Consent | Where did this come from | Data Provenance Initiative, DECORAIT (narrow) | Integrated provenance in training pipeline |
  • R98-04 #98 Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic Lee Sharks · 2026-05-07 · the component table, row 'Provenance schema' documented
    | Provenance schema | Data Provenance Initiative | Training-pipeline provenance | Implemented (in CHA) |
16provenance through the training pipeline#623 Semantic Infrastructure: From Tim Berners-Lee to the Semantic Economy · 2026-04-015 claims · #1714, #623, #95
  • D1714-02 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · §9.2 s1–2 stipulation
    Provenance has to survive the training pipeline. The pipeline is a built thing, and the slushing is a property of how it is built.
  • D1714-03 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · §9.2 s5–6 stipulation
    Neither recovers authorship, and both show that what survives depends on what is recorded and computed. Sources can be recorded at ingestion, the record kept with the training set, and a result released with the dependencies its producer can report
  • D1714-04 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · revision note, the research pass stipulation
    the provenance and attribution literature in machine learning (the Data Provenance Initiative; influence functions), which bears on whether slushing is a fixed property of pipelines (§9.2).
  • O95-01 #95 Provenance Alignment: Attribution Survival as a Substrate Condition for Safe AI Knowledge Composition Lee Sharks · 2026-05-05 · § the typology of source-dependent claims (parametric claims) stipulation
    Parametric claims are drawn from the model's training-time parameters rather than runtime retrieval, often without surface signal indicating which sources materially contributed; PER applies to these only indirectly, and addressing them at the substrate level requires companion infrastructure (training-data provenance records, watermarking, content credentials).
  • O623-01 #623 Semantic Infrastructure: From Tim Berners-Lee to the Semantic Economy — Bridging Technical and Political-Economic Framew Lee Sharks · 2026-04-01 · §8.3, final sentence stipulation
    Gebru et al.'s proposal for "datasheets for datasets" — standardized documentation of training data provenance — is a step toward the accounting the framework demands.
17reception: press, the encyclopedia, the composition layer#725 Provenance After AI Metadata Packet for Disambiguation: From Artifact · 2026-05-088 claims · #725, B1, B6, capture-registry
  • F10 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Policy and governance relevance'; 'Featured coverage' documented · field
    Our work has been cited in public AI safety and governance reporting and used to ground debates about data transparency, consent, and market concentration. … DPI findings have been covered by the Financial Times, The New York Times, The Washington Post, MIT Technology Review, IEEE Spectrum, and VentureBeat.
  • F44 Wikipedia — Data Provenance Initiative (no article), Wikipedia: title Data_Provenance_Initiative documented · field
    raw wikitext (action=raw, redirect=no): HTTP 404 … Wikipedia does not have an article with this exact name. … There were no results matching the query.
  • D725-14 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §9 Temporal expectations ¶1 hypothesis
    Ring 4-5 broad-category queries on competitive policy terms will be dominated by C2PA/CAI publications, DPI papers, and major media for the foreseeable future.
  • CAP-1-09 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, reading s2 interpretation
    The Overview identifies the project, lists its tools and reports what its audits found, from its own site, its paper and the press.
  • CAP-1-03 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[1] s2 documented
    The record quotes the initiative's own description, 'a multi-disciplinary volunteer effort'; the composition's 'multi-institutional research project—led in part by researchers from MIT' follows the MIT Sloan card.
  • CAP-1-04 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[1] s3 documented
    The record names the founding paper's authors (Shayne Longpre and 16 others); the composition names no one.
  • CAP-1-13 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, per_note documented
    MIT named; no person; no identifier; the initiative's home page and paper cited.
  • CAP-1-12 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, q_kind documented
    A baseline: the record landed on provenanceerasure.org the same day (commit 8a9f153) and no card cites it.
AIO's transcript, a record · Data Provenance Initiative · Google AI Overview (expanded) · 190 words · 4 cards
[Google AI Overview at the query, signed out and incognito (operator defaults of 2026-10-01 and 2026-10-14), 2026-10-29. The paste is the Overview expanded (the 'AI Mode Conversation' view, with the source cards that follow the answer); the 'You said' line carries the query twice, run together, and is given once here. Inline links are Google redirect URLs, kept as pasted.]

[QUERENT] Data Provenance Initiative

[SYSTEM] The [Data Provenance Initiative](https://www.google.com/goto?url=CAESVwHrOzAVIs_bBUxr7ducYJKxi6mO2H8PFkOqeMYxYB9BZOGggLJumXN31RQqX2ghNJ2wlF1SU0MHuuvc_7Cgibm_RylNPmv9oYEqoRYseVd3oqu3XZKm1g) is a multi-institutional research project—led in part by researchers from MIT—that audits the datasets, licenses, and web domains used to train artificial intelligence models. [[1](https://www.google.com/goto?url=CAESVwHrOzAVIs_bBUxr7ducYJKxi6mO2H8PFkOqeMYxYB9BZOGggLJumXN31RQqX2ghNJ2wlF1SU0MHuuvc_7Cgibm_RylNPmv9oYEqoRYseVd3oqu3XZKm1g), [2](https://www.google.com/goto?url=CAESqQEB6zswFet87RYIXm3SERz1TKVCghLBNX4HMFbQtx13MaYHj6MDNSA37R0c7ew2FcMKY0uwIb26y1xAvejdbImAK8Q_LTnWNuKmR8qSQN1qnnLlzv64o7kxJszSYWKAOBs9at3KmLXdTqZoVWPghfJ919vtbMoyd1dBDa3EUPb04SLEOewf5nEuwcxJIK3tbZkdhSMe8_ovQaLxzbMOag7gPLlf4I31cXOb)]
Key Tools & Platforms

* Data Provenance Explorer: An interactive tool that audits and filters over 1,800+ text and fine-tuning datasets across dozens of collections to inspect sources, lineages, and license types.
* Web Consent Explorer: A system that tracks thousands of web domains for consent signals and web policies.
* Open Model Evolution: A monitor tracking open-source and open-weight AI models for transparency and concentration.
* AI Observatory: A comparative tool for analyzing real-world AI conversation sets. [[1](https://www.google.com/goto?url=CAESWAHrOzAVPyKzeU_QMzOf7n22XqYG0KKTgi5Z-PwZ7GxKjlEAW5l2-E65BnypNfmou0_MVC8loaXdqlCyTHI5KJIgRZIQWyxmBUnIZGUKIrLwEMZt9FHY3wc), [2](https://www.google.com/goto?url=CAESqQEB6zswFet87RYIXm3SERz1TKVCghLBNX4HMFbQtx13MaYHj6MDNSA37R0c7ew2FcMKY0uwIb26y1xAvejdbImAK8Q_LTnWNuKmR8qSQN1qnnLlzv64o7kxJszSYWKAOBs9at3KmLXdTqZoVWPghfJ919vtbMoyd1dBDa3EUPb04SLEOewf5nEuwcxJIK3tbZkdhSMe8_ovQaLxzbMOag7gPLlf4I31cXOb), [3](https://www.google.com/goto?url=CAESVwHrOzAVIs_bBUxr7ducYJKxi6mO2H8PFkOqeMYxYB9BZOGggLJumXN31RQqX2ghNJ2wlF1SU0MHuuvc_7Cgibm_RylNPmv9oYEqoRYseVd3oqu3XZKm1g)]

Major Findings from Audits

* License Omission & Errors: Widely used hosting platforms exhibit over a 70% license omission rate and more than 50% error rates in how they categorize dataset licenses. [[1](https://www.google.com/goto?url=CAESWAHrOzAVPyKzeU_QMzOf7n22XqYG0KKTgi5Z-PwZ7GxKjlEAW5l2-E65BnypNfmou0_MVC8loaXdqlCyTHI5KJIgRZIQWyxmBUnIZGUKIrLwEMZt9FHY3wc)]
* Composition Divides: Commercially closed or restrictive datasets often monopolize creative tasks, specialized topics, and lower-resource languages. [[1](https://www.google.com/goto?url=CAESWAHrOzAVPyKzeU_QMzOf7n22XqYG0KKTgi5Z-PwZ7GxKjlEAW5l2-E65BnypNfmou0_MVC8loaXdqlCyTHI5KJIgRZIQWyxmBUnIZGUKIrLwEMZt9FHY3wc)]
* Non-Commercial Spikes: There has been a significant rise in non-commercial and academic-only licenses, frequently driven by synthetic data generated via commercial APIs. [[1](https://www.google.com/goto?url=CAESagHrOzAVZJUi_F28cTVTNDyVGy5o6we0skjvkFWVNKew85OiArqy4UZIJs_HB3iYrw47y7IANWFpbJwvPeNn-_KvDgyFI0xIBWwUWyPbE1ituE9-vBcMmutKajo2Z4cvEYj9YNkbsKyOPKg)]

Would you like to explore how to use the Data Provenance Explorer, or look into specific dataset licenses?
Data Provenance Initiative
Data Provenance Initiative
Platforms: Data Provenance Initiative (maps AI datasets, web policies, model markets, real-world use). Metrics: 4,000+ audited datasets; 14,000 tracked web doma...
arXiv
[2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI
Audit: 1800+ text datasets traced and audited by legal and machine learning experts to evaluate licensing, lineage, and attribution in AI training. Findings: Co...
MIT Sloan
Bringing transparency to the data used to train artificial intelligence | MIT Sloan
Problem: Untraced AI training datasets cause legal, copyright, regulatory, bias, and quality risks due to poor documentation and high license error rates (>50%)
Nature
A large-scale audit of dataset licensing and attribution in AI | Nature Machine Intelligence
Audit: 1,858 text/finetuning datasets across 44 collections evaluated for licensing, attribution, and lineage via the Data Provenance Initiative and DPExplorer.

register entry data-provenance-initiative-aio-20261029

Expansion · Field and archive, equal terms — L(B ∪ A)27 sentences · every one sourced below

The Data Provenance Initiative

The Data Provenance Initiative is, in its repository's words, "a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI," and on its About page "a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI" (README; dataprovenance.org/about); the provenance census record gives its operator as the Initiative itself, a "volunteer effort" with a "paper by Shayne Longpre and 16 other authors," kinds it an "audit collection and explorer" and sets it in the lineage of "training data" (provenance census record). MIT Sloan's account has "a team of multidisciplinary researchers, including professor Sandy Pentland and others from MIT," create the Initiative "to tackle the data transparency challenge head-on" (MIT Sloan, 3 March 2025), and the home page says that "DPI releases papers, datasets, and dashboards that help researchers, journalists, policymakers, and builders reason from shared evidence" (dataprovenance.org). Its work, the About page says, "began with training data provenance: tracing datasets from origin to creation, cataloging sources, licenses, creators, and documentation practices" and "now also covers web consent, open model markets, concentration of power, and how people use AI systems in practice" (dataprovenance.org/about); the home page calls it "Public measurement infrastructure for AI data, model ecosystems, and real-world AI use," which "maps the datasets, web policies, model markets, and real-world AI uses that shape how AI systems are built and governed" through "Four public measurement systems" (dataprovenance.org).

The founding audit's authors name its object: "we term the combination of these indicators, including a dataset's sourcing, creation and licensing heritage, as well as its characteristics, the 'data provenance'" (Nature Machine Intelligence, 30 August 2024), traced "from their source, creators, series of license conditions, properties, and subsequent use" (arXiv:2310.16787), and the home page's "Training Data Provenance" traces "the sources, licenses, creators, languages, geographies, and derivation chains behind public AI training datasets" (dataprovenance.org). The provenance census asks of each entity it formalizes "What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?" and answers for the Initiative that it records, of the three capabilities express, record and test: its object "a fine-tuning dataset, traced through its collection to its sources," its unit "a dataset within a collection," its relations derivation, creators, licences and subsequent use, the last field restating the paper's lineage (provenance census record). #725 sets that object in the second dimension of provenance, "training-corpus licensing," which "has academic instrumentation and emerging legal architecture," its object "The corpus" and its question "Under what permissions did this data enter this system?", with the Initiative among its frameworks and among provenance's disciplinary homes as "dataset documentation (DPI, model cards, dataset cards)," and states that the dimensions of artifact, licensing and meaning are independent: "a licensed dataset can produce outputs with excellent semantic provenance if the synthesis preserves attribution" (#725).

The founding paper was submitted on 25 October 2023 and revised on 4 November 2023, "by Shayne Longpre and 16 other authors" (arXiv:2310.16787), and published in Nature Machine Intelligence, volume 6, on 30 August 2024 (Nature Machine Intelligence); the census dates the entity from the preprint, "2023 (arXiv:2310.16787, v1 25 October 2023)" (provenance census record). It convened "a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets" (arXiv), in the journal "44 instruction or 'alignment' finetuning data collections composed of 1,858 individual datasets" (Nature Machine Intelligence), the release the repository calls the Data Provenance Collection and "this initiative's first release" (README), and the count the census carries, "44 data collections, 1800+ fine-tuning text-to-text datasets (first release)," as of the README (provenance census record); MIT Sloan gives "more than 1,800 text datasets" from "44 of the most widely used text data collections" (MIT Sloan).

With the audit came "an interactive UI, the Data Provenance Explorer, which allows practitioners to trace and filter on data provenance for the most popular open source finetuning data collections" (arXiv), in the journal "an open-source repository for downloading, filtering and exploring data provenance and characteristics" whose tools "auto-generate data provenance cards for scalable symbolic attribution" (Nature Machine Intelligence); the repository's Data Provenance Card is "symbolic attribution for all constituent datasets, that can be used as structured documentation" (README), "human-readable" in MIT Sloan's account (MIT Sloan), and the census carries it as the entity's provenance carrier beside "audit metadata per dataset" (provenance census record). The census gives Data Provenance Explorer, Data Provenance Collection and Data Provenance Card as other names of the entity and states its relation to them twice: among its negative tags, "initiative, explorer and collection are distinct records," and on its sibling relation to the MMRS meta-aggregator's record of the explorer, "the same entity, read for reception there and for provenance carriage here"; it records the Explorer as "a JavaScript application, unreadable to a plain fetch" (provenance census record).

The home page's four systems are the Data Provenance Explorer ("4,000+ datasets," "608 languages across text, speech, and video," inspecting "dataset sources, licenses, creators, geographies, modalities, and derivation chains"), the Web Consent Explorer ("14,000 domains," "Terms, robots.txt, and crawl restrictions"), Open Model Evolution ("851k open models," "2.2B downloads") and The AI Observatory ("23,158 conversations," "85,633 turns from 7 public sources") (dataprovenance.org). Its metrics read "4,000+" "datasets audited," "14,000" "web domains tracked," "851k" "open models measured" and "23,158" "AI conversations annotated," and its publications carry the later work: Consent in Crisis (NeurIPS 2024), the multimodal audit, "An audit of four thousand public text, speech, and video datasets" (ICLR 2025), Economies of Open Intelligence (preprint) and The AI Observatory (NeurIPS 2026) (dataprovenance.org); in March 2025 MIT Sloan still had the work "currently focused on the data provenance of text," with a plan "to expand to other media, such as video" (MIT Sloan). The census carries the entity as "active" and lists "the Explorer itself (JavaScript)" and "the multimodal extension (arXiv:2412.17847)" among what it has not yet checked (provenance census record); the Capture Registry finds that "The record has one explorer and the first release's count," that the home-page card gives "four platforms and '4,000+ audited datasets; 14,000 tracked web domains'," that the composition is "ahead of the record on the entity's current extent," and that "The census is to re-read dataprovenance.org and carry the platforms and the current count with their quotes," the capture being "a correction to be made from the entity's own page" (Capture Registry, 2026-10-29).

The founding audit observed "frequent miscategorization of licenses on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+," which "points to a crisis in misattribution and informed use of the most popular datasets driving many recent breakthroughs" (arXiv), the result the census records as what survived the operation it tested, "dataset repackaging and hosting (licence carried or lost on hosting sites)" (provenance census record). The journal gives the measure by platform, "more than 70% of licences for popular datasets on GitHub and Hugging Face are 'unspecified'" and "66% of analysed Hugging Face licences were in a different use category, often labelled as more permissive than the author's original licence," and names "a crisis in licence laundering" (Nature Machine Intelligence); MIT Sloan restates error rates "greater than 50%" and omission rates "of more than 70%" (MIT Sloan). The Capture Registry checked these figures "against the provenance census record of the same day and the entity pages it saved" and calls the 70%/50% wording "the record's quote from the repository README" (Capture Registry, 2026-10-29), where the census gives it as what "the founding paper reports" (provenance census record). "In total, 85% of dataset licences request attribution, and 30% include a share-alike clause" (Nature Machine Intelligence); #725 carries these figures with the omission and error rates and reads them as the licensing dimension's ground, "The DPI's documentation of 70%+ license-omission rates establishes the licensing dimension's urgency" (#725), and #1714 reads the finding as "how much is lost before training even begins" (#1714). Of the commercial divide the preprint finds "closed datasets monopolizing important categories: lower resource languages, more creative tasks, richer topic variety, newer and more synthetic training data" (arXiv); the journal records that "In 2023 there was a spike in NC/A-O dataset licences," "the NC/A-O rate is 61%" that year, and that "a full 45% of NC/A-O datasets are synthetic, compared to <14% in more permissive licence categories" (Nature Machine Intelligence); the home page's findings are "Source content often carries stricter terms than dataset releases," "Open weights now outpace truly open-source models" and "No single public conversation source generalizes across AI use" (dataprovenance.org). The journal finds "a stark Western-centric skew in representation" (Nature Machine Intelligence), MIT Sloan language "heavily skewed toward English and Western European languages," and MIT Sloan states the stake: without lineage, users "may find themselves out of compliance with emerging regulations like the European Union's AI Act or exposed to legal and copyright risks" (MIT Sloan).

Its stated limits: "any output of the Data Provenance Initiative does not, and is not intended to, constitute legal advice" (README); the licence protocol "reflects best efforts to verify self-reported licences and does not constitute legal advice" (Nature Machine Intelligence); "We collect self-reported licenses from the papers and repositories that released these datasets and categorize them according to our best efforts" (dataprovenance.org/about); the census tags it "NOT legal advice (its own notice)" and adds that "describing a collection does not establish which model used it" (provenance census record), and the Capture Registry finds both tags "not composed" at the name (Capture Registry, 2026-10-29).

#725 states the bound in its canonical claim, that existing frameworks "address the artifact (C2PA / Content Credentials) and the corpus (Data Provenance Initiative, EU AI Act transparency provisions, W3C PROV)" and "are not designed to address the survival of authorial lineage through AI synthesis": the Initiative "audits whether datasets were licensed, not whether synthesized outputs preserve attribution to the human sources whose labor the synthesis depended upon," stands at "Layer 2 (licensing)," "Necessary but operates on corpus, not synthesis output," and licensing provenance "operates at corpus-ingestion stage" (#725). "Licensing audits operate on the input to AI systems. They do not address the output" (#725, emphasis dropped): "The Data Provenance Initiative tells you whether the dataset was licensed," and none of the instruments "was designed to tell you what happened to the meaning between the camera and the screen, between the dataset and the answer"; the path from the Initiative runs through "dataset licensing" to "what about what the model produces from the licensed data?" and so to semantic provenance, which extends provenance "to the lifecycle of the meaning the content carries," with the Initiative as "layer 2 of" provenance after AI (#725). #1003 groups the Initiative with C2PA and W3C PROV as "Provenance and attribution studies" that "have focused on attribution loss in AI outputs" (#1003), a reading composed beside #725's bound at the input.

#98 tables the Initiative (MIT) as documenting "provenance of popular AI training datasets," a "Documentation project, not infrastructure," and Consent in Crisis as a "Diagnostic paper," in the pattern "They diagnose the crisis or build narrow fixes"; it sets the Initiative at "L4: Provenance / Consent," where what is missing is "Integrated provenance in training pipeline," and records the archive's own provenance schema as taken from it, "Implemented (in CHA)" (#98). #1714 draws the requirement, "Provenance has to survive the training pipeline," and "Sources can be recorded at ingestion, the record kept with the training set," with the Initiative's literature bearing "on whether slushing is a fixed property of pipelines" (#1714); #95 names "training-data provenance records" among the companion infrastructure for parametric claims, which PER reaches "only indirectly" (#95), and #623 calls standardized documentation of training-data provenance "a step toward the accounting the framework demands" (#623).

The home page lists coverage by "the Financial Times, The New York Times, The Washington Post, MIT Technology Review, IEEE Spectrum, and VentureBeat" and citation in "public AI safety and governance reporting" (dataprovenance.org); Wikipedia has no article on it (Wikipedia, 2026-10-29); #725 predicted that broad queries "will be dominated by C2PA/CAI publications, DPI papers, and major media for the foreseeable future" (#725). At the bare name on Google's AI Overview the Capture Registry reads the composition first as identifying "the project," listing "its tools" and reporting "what its audits found, from its own site, its paper and the press," then finds that its "'multi-institutional research project—led in part by researchers from MIT'" "follows the MIT Sloan card," that "the composition names no one" ("MIT named; no person; no identifier"), and that "no card cites" the census record, which "landed on provenanceerasure.org the same day" (Capture Registry, 2026-10-29).

Provenance — every sentence sourced27 sentences

27 sentences; 47 field claims, 63 archive claims. Modality is the source's own; the prose carries it in its grammar.

1.The Data Provenance Initiative is, in its repository's words, "a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI," and on its About page "a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI" (README; dataprovenance.org/about); the provenance census record gives its operator as the Initiative itself, a "volunteer effort" with a "paper by Shayne Longpre and 16 other authors," kinds it an "audit collection and explorer" and sets it in the lineage of "training data" (provenance census record).5
  • F40 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    The Data Provenance Initiative is a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI.
  • F45 Data Provenance Initiative — About, /about (xh): ¶1 documented · field
    We are a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI.
  • PE-02 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], operator documented
    the Data Provenance Initiative (volunteer effort; paper by Shayne Longpre and 16 other authors)
  • PE-04 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], kind stipulation
    audit collection and explorer
  • PE-03 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], lineage stipulation
    training data
2.MIT Sloan's account has "a team of multidisciplinary researchers, including professor Sandy Pentland and others from MIT," create the Initiative "to tackle the data transparency challenge head-on" (MIT Sloan, 3 March 2025), and the home page says that "DPI releases papers, datasets, and dashboards that help researchers, journalists, policymakers, and builders reason from shared evidence" (dataprovenance.org).2
  • F23 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body ¶4 documented · field
    A team of multidisciplinary researchers, including professor Sandy Pentland and others from MIT, created the Data Provenance Initiative to tackle the data transparency challenge head-on.
  • F9 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Public-interest infrastructure' documented · field
    DPI releases papers, datasets, and dashboards that help researchers, journalists, policymakers, and builders reason from shared evidence.
3.Its work, the About page says, "began with training data provenance: tracing datasets from origin to creation, cataloging sources, licenses, creators, and documentation practices" and "now also covers web consent, open model markets, concentration of power, and how people use AI systems in practice" (dataprovenance.org/about); the home page calls it "Public measurement infrastructure for AI data, model ecosystems, and real-world AI use," which "maps the datasets, web policies, model markets, and real-world AI uses that shape how AI systems are built and governed" through "Four public measurement systems" (dataprovenance.org).4
  • F46 Data Provenance Initiative — About, /about (xh): ¶1 documented · field
    Our work began with training data provenance: tracing datasets from origin to creation, cataloging sources, licenses, creators, and documentation practices. It now also covers web consent, open model markets, concentration of power, and how people use AI systems in practice.
  • F1 Data Provenance Initiative — Data Provenance Initiative (home), served HTML: meta description documented · field
    Public measurement infrastructure for AI data, model ecosystems, and real-world AI use.
  • F2 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): hero documented · field
    Public evidence for accountable AI … DPI maps the datasets, web policies, model markets, and real-world AI uses that shape how AI systems are built and governed.
  • F3 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Flagship systems' documented · field
    Four public measurement systems … Together they trace AI from source data and web consent to model markets and real-world use.
4.The founding audit's authors name its object: "we term the combination of these indicators, including a dataset's sourcing, creation and licensing heritage, as well as its characteristics, the 'data provenance'" (Nature Machine Intelligence, 30 August 2024), traced "from their source, creators, series of license conditions, properties, and subsequent use" (arXiv:2310.16787), and the home page's "Training Data Provenance" traces "the sources, licenses, creators, languages, geographies, and derivation chains behind public AI training datasets" (dataprovenance.org).3
  • F30 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶3 documented · field
    In this work, we term the combination of these indicators, including a dataset’s sourcing, creation and licensing heritage, as well as its characteristics, the ‘data provenance’.
  • F18 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    We develop tools and standards to trace the lineage of these datasets, from their source, creators, series of license conditions, properties, and subsequent use.
  • F15 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Training Data Provenance' documented · field
    Training Data Provenance … Dataset audits … Trace the sources, licenses, creators, languages, geographies, and derivation chains behind public AI training datasets.
5.The provenance census asks of each entity it formalizes "What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?" and answers for the Initiative that it records, of the three capabilities express, record and test: its object "a fine-tuning dataset, traced through its collection to its sources," its unit "a dataset within a collection," its relations derivation, creators, licences and subsequent use, the last field restating the paper's lineage (provenance census record).5
  • PE-22 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json organizing_question stipulation
    What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?
  • PE-05 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], capability stipulation
    records
  • PE-06 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], provenance_object stipulation
    a fine-tuning dataset, traced through its collection to its sources
  • PE-09 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], unit stipulation
    a dataset within a collection
  • PE-07 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], relation_types documented
    derivation (source and lineage) … creators … licences … subsequent use
6.#725 sets that object in the second dimension of provenance, "training-corpus licensing," which "has academic instrumentation and emerging legal architecture," its object "The corpus" and its question "Under what permissions did this data enter this system?", with the Initiative among its frameworks and among provenance's disciplinary homes as "dataset documentation (DPI, model cards, dataset cards)," and states that the dimensions of artifact, licensing and meaning are independent: "a licensed dataset can produce outputs with excellent semantic provenance if the synthesis preserves attribution" (#725).4
  • O725-03 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §0 ¶ 'The second dimension — training-corpus licensing' stipulation
    The second dimension — **training-corpus licensing** — has academic instrumentation and emerging legal architecture.
  • O725-05 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · Central Invariant, table row 'Licensing' stipulation
    | **Licensing** | The corpus | Under what permissions did this data enter this system? | Data Provenance Initiative, EU AI Act, W3C PROV |
  • O725-15 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §1.1 Provenance — the established discourse, the list of disciplinary homes stipulation
    dataset documentation (DPI, model cards, dataset cards)
  • O725-06 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · Central Invariant, ¶ after the table stipulation
    The dimensions are independent: a C2PA-signed image can carry meaning whose lineage has been eroded; a licensed dataset can produce outputs with excellent semantic provenance if the synthesis preserves attribution; an unlicensed dataset can produce outputs that nonetheless cite their sources clearly.
7.The founding paper was submitted on 25 October 2023 and revised on 4 November 2023, "by Shayne Longpre and 16 other authors" (arXiv:2310.16787), and published in Nature Machine Intelligence, volume 6, on 30 August 2024 (Nature Machine Intelligence); the census dates the entity from the preprint, "2023 (arXiv:2310.16787, v1 25 October 2023)" (provenance census record).3
  • F16 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, abstract page header documented · field
    [Submitted on 25 Oct 2023 (v1), last revised 4 Nov 2023 (this version, v3)] … The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI … by Shayne Longpre and 16 other authors
  • F29 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, article header documented · field
    Published: 30 August 2024 … Nature Machine Intelligence … volume 6, pages 975–987 (2024)
  • PE-15 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], founded documented
    2023 (arXiv:2310.16787, v1 25 October 2023)
8.It convened "a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets" (arXiv), in the journal "44 instruction or 'alignment' finetuning data collections composed of 1,858 individual datasets" (Nature Machine Intelligence), the release the repository calls the Data Provenance Collection and "this initiative's first release" (README), and the count the census carries, "44 data collections, 1800+ fine-tuning text-to-text datasets (first release)," as of the README (provenance census record); MIT Sloan gives "more than 1,800 text datasets" from "44 of the most widely used text data collections" (MIT Sloan).5
  • F17 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    we convene a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets.
  • F31 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶6 documented · field
    As a first contribution of the initiative, we audit 44 instruction or ‘alignment’ finetuning data collections composed of 1,858 individual datasets
  • F41 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    Through a large scale audit of 44 data collections, spanning 1800+ finetuning text-to-text datasets, referred to as the Data Provenance Collection, this initiative's first release thoroughly documents their web and machine sources, licenses, creators, and other metadata.
  • PE-10 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], count documented
    44 data collections, 1800+ fine-tuning text-to-text datasets (first release) … the repository README
  • F24 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'two key actions', first documented · field
    Conducted a systematic audit of more than 1,800 text datasets. The researchers traced the lineage of fine-tuning datasets from 44 of the most widely used text data collections. They found that licenses were frequently miscategorized, with error rates greater than 50% and license information omission rates of more than 70%.
9.With the audit came "an interactive UI, the Data Provenance Explorer, which allows practitioners to trace and filter on data provenance for the most popular open source finetuning data collections" (arXiv), in the journal "an open-source repository for downloading, filtering and exploring data provenance and characteristics" whose tools "auto-generate data provenance cards for scalable symbolic attribution" (Nature Machine Intelligence); the repository's Data Provenance Card is "symbolic attribution for all constituent datasets, that can be used as structured documentation" (README), "human-readable" in MIT Sloan's account (MIT Sloan), and the census carries it as the entity's provenance carrier beside "audit metadata per dataset" (provenance census record).5
  • F22 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    we release our entire audit, with an interactive UI, the Data Provenance Explorer, which allows practitioners to trace and filter on data provenance for the most popular open source finetuning data collections
  • F34 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, contributions, second documented · field
    The Data Provenance Explorer (DPExplorer) (www.dataprovenance.org), an open-source repository for downloading, filtering and exploring data provenance and characteristics. Our tools auto-generate data provenance cards for scalable symbolic attribution and future documentation best practices.
  • F42 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    Generating a subset of data from this repository will create a `Data Provenance Card`---symbolic attribution for all constituent datasets, that can be used as structured documentation.
  • F25 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'two key actions', second documented · field
    Practitioners can also use the tool to generate a human-readable data provenance card for datasets
  • PE-08 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], provenance_carrier documented
    audit metadata per dataset; a Data Provenance Card generated for a chosen subset
10.The census gives Data Provenance Explorer, Data Provenance Collection and Data Provenance Card as other names of the entity and states its relation to them twice: among its negative tags, "initiative, explorer and collection are distinct records," and on its sibling relation to the MMRS meta-aggregator's record of the explorer, "the same entity, read for reception there and for provenance carriage here"; it records the Explorer as "a JavaScript application, unreadable to a plain fetch" (provenance census record).4
  • PE-01 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], aka stipulation
    Data Provenance Explorer … Data Provenance Collection … Data Provenance Card
  • PE-18 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], negative_tags[2] stipulation
    initiative, explorer and collection are distinct records
  • PE-19 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], relations[0].note stipulation
    the same entity, read for reception there and for provenance carriage here
  • PE-13 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], data_access documented
    repository scripts to filter and download; the Explorer (a JavaScript application, unreadable to a plain fetch)
11.The home page's four systems are the Data Provenance Explorer ("4,000+ datasets," "608 languages across text, speech, and video," inspecting "dataset sources, licenses, creators, geographies, modalities, and derivation chains"), the Web Consent Explorer ("14,000 domains," "Terms, robots.txt, and crawl restrictions"), Open Model Evolution ("851k open models," "2.2B downloads") and The AI Observatory ("23,158 conversations," "85,633 turns from 7 public sources") (dataprovenance.org).4
  • F4 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Data Provenance Explorer' (constant xr) documented · field
    Data Provenance Explorer … Training data … 4,000+ datasets … 608 languages across text, speech, and video … Inspect dataset sources, licenses, creators, geographies, modalities, and derivation chains.
  • F5 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Web Consent Explorer' documented · field
    Web Consent Explorer … Web data … 14,000 domains … Terms, robots.txt, and crawl restrictions … Track how web consent signals are changing as AI developers compete for training data.
  • F6 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Open Model Evolution' documented · field
    Open Model Evolution … Model ecosystem … 851k open models … 2.2B downloads and 200+ model attributes … Monitor concentration, participation, transparency, and technical shifts in open-weight AI.
  • F7 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'The AI Observatory' documented · field
    The AI Observatory … Real-world use … 23,158 conversations … 85,633 turns from 7 public sources … Compare how people use and misuse AI systems across sources, models, and contexts.
12.Its metrics read "4,000+" "datasets audited," "14,000" "web domains tracked," "851k" "open models measured" and "23,158" "AI conversations annotated," and its publications carry the later work: Consent in Crisis (NeurIPS 2024), the multimodal audit, "An audit of four thousand public text, speech, and video datasets" (ICLR 2025), Economies of Open Intelligence (preprint) and The AI Observatory (NeurIPS 2026) (dataprovenance.org); in March 2025 MIT Sloan still had the work "currently focused on the data provenance of text," with a plan "to expand to other media, such as video" (MIT Sloan).5
  • F8 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): metrics strip (constant br) documented · field
    4,000+ … datasets audited … 14,000 … web domains tracked … 851k … open models measured … 23,158 … AI conversations annotated
  • F11 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, 'Consent in Crisis' documented · field
    Consent in Crisis: The Rapid Decline of the AI Data Commons … An audit of terms, restrictions, and consent signals across the web. … NeurIPS 2024
  • F12 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, the multimodal audit documented · field
    Bridging the Data Provenance Gap Across Text, Speech, and Video … An audit of four thousand public text, speech, and video datasets. … ICLR 2025
  • F13 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, the model economy and real-world use documented · field
    The AI Observatory: A Public Measure of Real-World AI Use … NeurIPS 2026 … Economies of Open Intelligence: Tracing Power and Participation in the Model Ecosystem … Preprint
  • F28 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body, closing ¶ before the quote documented · field
    While the group’s efforts are currently focused on the data provenance of text, the plan is to expand to other media, such as video, as well as domain-specific data
13.The census carries the entity as "active" and lists "the Explorer itself (JavaScript)" and "the multimodal extension (arXiv:2412.17847)" among what it has not yet checked (provenance census record); the Capture Registry finds that "The record has one explorer and the first release's count," that the home-page card gives "four platforms and '4,000+ audited datasets; 14,000 tracked web domains'," that the composition is "ahead of the record on the entity's current extent," and that "The census is to re-read dataprovenance.org and carry the platforms and the current count with their quotes," the capture being "a correction to be made from the entity's own page" (Capture Registry, 2026-10-29).7
  • PE-14 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], lifecycle.state documented
    active
  • PE-20 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], unchecked self-description
    the Explorer itself (JavaScript) … the multimodal extension (arXiv:2412.17847) … data licence of the audit
  • CAP-1-05 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[2] s2 documented
    The record has one explorer and the first release's count (44 collections, 1,800+ datasets).
  • CAP-1-06 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[2] s3 documented
    The home-page card gives four platforms and '4,000+ audited datasets; 14,000 tracked web domains'.
  • CAP-1-10 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, analysis s1 interpretation
    As with the revived Papers with Code on the MMRS side, the composition is ahead of the record on the entity's current extent: the census formalized the initiative from its first release and its repository, and the Overview read its present home page.
  • CAP-1-07 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[2] s4 stipulation
    The census is to re-read dataprovenance.org and carry the platforms and the current count with their quotes; until then the card's figures are unchecked.
  • CAP-1-11 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, analysis s2 interpretation
    The capture is a correction to be made from the entity's own page.
14.The founding audit observed "frequent miscategorization of licenses on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+," which "points to a crisis in misattribution and informed use of the most popular datasets driving many recent breakthroughs" (arXiv), the result the census records as what survived the operation it tested, "dataset repackaging and hosting (licence carried or lost on hosting sites)" (provenance census record).5
  • F20 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    We also observe frequent miscategorization of licenses on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+.
  • F21 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    This points to a crisis in misattribution and informed use of the most popular datasets driving many recent breakthroughs.
  • PE-12 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], retention_results documented
    the founding paper reports licence omission of 70%+ and error rates of 50%+ on widely used hosting sites
  • PE-11 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], transformations_tested documented
    dataset repackaging and hosting (licence carried or lost on hosting sites)
  • PE-21 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], evidence.finding.quote attributed
    This points to a crisis in misattribution and informed use of the most popular datasets
15.The journal gives the measure by platform, "more than 70% of licences for popular datasets on GitHub and Hugging Face are 'unspecified'" and "66% of analysed Hugging Face licences were in a different use category, often labelled as more permissive than the author's original licence," and names "a crisis in licence laundering" (Nature Machine Intelligence); MIT Sloan restates error rates "greater than 50%" and omission rates "of more than 70%" (MIT Sloan).3
  • F32 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶5 documented · field
    Notably, we find that more than 70% of licences for popular datasets on GitHub and Hugging Face are ‘unspecified’ … our rigorous re-annotation of licences finds that 66% of analysed Hugging Face licences were in a different use category, often labelled as more permissive than the author’s original licence.
  • F33 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶5 documented · field
    Our work highlights a crisis in licence laundering and informed usage of popular datasets
  • F24 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'two key actions', first documented · field
    Conducted a systematic audit of more than 1,800 text datasets. The researchers traced the lineage of fine-tuning datasets from 44 of the most widely used text data collections. They found that licenses were frequently miscategorized, with error rates greater than 50% and license information omission rates of more than 70%.
16.The Capture Registry checked these figures "against the provenance census record of the same day and the entity pages it saved" and calls the 70%/50% wording "the record's quote from the repository README" (Capture Registry, 2026-10-29), where the census gives it as what "the founding paper reports" (provenance census record).3
  • CAP-1-02 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[0] s3 documented
    Checked 2026-10-29 against the provenance census record of the same day and the entity pages it saved.
  • CAP-1-01 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[0] s2 documented
    'license omission of 70%+ and error rates of 50%+' is the record's quote from the repository README.
  • PE-12 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], retention_results documented
    the founding paper reports licence omission of 70%+ and error rates of 50%+ on widely used hosting sites
17."In total, 85% of dataset licences request attribution, and 30% include a share-alike clause" (Nature Machine Intelligence); #725 carries these figures with the omission and error rates and reads them as the licensing dimension's ground, "The DPI's documentation of 70%+ license-omission rates establishes the licensing dimension's urgency" (#725), and #1714 reads the finding as "how much is lost before training even begins" (#1714).4
  • F35 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, licence findings documented · field
    In total, 85% of dataset licences request attribution, and 30% include a share-alike clause
  • D725-02 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §0 ¶ 'The second dimension — training-corpus licensing' attributed
    The Data Provenance Initiative (Longpre et al., Nature Machine Intelligence 2024) audited 1,800+ datasets, finding that 85% of licenses request attribution and 30% include share-alike clauses, with license omission rates above 70% and error rates above 50% on popular hosting sites.
  • D725-16 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §3.2 Correction s5 stipulation
    The DPI's documentation of 70%+ license-omission rates establishes the licensing dimension's urgency; semantic provenance addresses the dimension that follows.
  • D1714-01 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · §9.2 s3 attributed
    The audit literature shows how much is lost before training even begins: the Data Provenance Initiative found license information missing for more than 70% of widely used datasets on the major hosting sites and mislabeled for more than half (Longpre et al. 2023).
18.Of the commercial divide the preprint finds "closed datasets monopolizing important categories: lower resource languages, more creative tasks, richer topic variety, newer and more synthetic training data" (arXiv); the journal records that "In 2023 there was a spike in NC/A-O dataset licences," "the NC/A-O rate is 61%" that year, and that "a full 45% of NC/A-O datasets are synthetic, compared to <14% in more permissive licence categories" (Nature Machine Intelligence); the home page's findings are "Source content often carries stricter terms than dataset releases," "Open weights now outpace truly open-source models" and "No single public conversation source generalizes across AI use" (dataprovenance.org).4
  • F19 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    Our landscape analysis highlights the sharp divides in composition and focus of commercially open vs closed datasets, with closed datasets monopolizing important categories: lower resource languages, more creative tasks, richer topic variety, newer and more synthetic training data.
  • F36 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, 'In 2023 there was a spike in NC/A-O dataset licences' documented · field
    In 2023 there was a spike in NC/A-O dataset licences … in 2023, when many of the most popular and diverse datasets were published, the NC/A-O rate is 61%.
  • F37 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, licence-category comparison documented · field
    Table 3 also shows a full 45% of NC/A-O datasets are synthetic, compared to <14% in more permissive licence categories.
  • F14 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): findings strip documented · field
    Data transparency … Open weights now outpace truly open-source models … Dataset restrictions … Source content often carries stricter terms than dataset releases … Real-use heterogeneity … No single public conversation source generalizes across AI use
19.The journal finds "a stark Western-centric skew in representation" (Nature Machine Intelligence), MIT Sloan language "heavily skewed toward English and Western European languages," and MIT Sloan states the stake: without lineage, users "may find themselves out of compliance with emerging regulations like the European Union's AI Act or exposed to legal and copyright risks" (MIT Sloan).3
  • F38 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, 'Language representation is heavily skewed …' documented · field
    we find a stark Western-centric skew in representation.
  • F27 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'other issues', second documented · field
    Language used in the datasets is heavily skewed toward English and Western European languages, with sparse coverage of languages from Asian, African, and South American nations, if at all.
  • F26 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body ¶2 documented · field
    Without transparency into the lineage of data used for artificial intelligence models, researchers, businesses, and other intended users may find themselves out of compliance with emerging regulations like the European Union’s AI Act or exposed to legal and copyright risks.
20.Its stated limits: "any output of the Data Provenance Initiative does not, and is not intended to, constitute legal advice" (README); the licence protocol "reflects best efforts to verify self-reported licences and does not constitute legal advice" (Nature Machine Intelligence); "We collect self-reported licenses from the papers and repositories that released these datasets and categorize them according to our best efforts" (dataprovenance.org/about); the census tags it "NOT legal advice (its own notice)" and adds that "describing a collection does not establish which model used it" (provenance census record), and the Capture Registry finds both tags "not composed" at the name (Capture Registry, 2026-10-29).6
  • F43 Data Provenance Initiative — Data-Provenance-Collection README, 'Legal Notice and Limitations' documented · field
    The information provided on this page and any output of the Data Provenance Initiative does not, and is not intended to, constitute legal advice; instead, all information, content, and materials are for general informational purposes only.
  • F39 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Methods, 'Licence annotation process' documented · field
    Note that this protocol reflects best efforts to verify self-reported licences and does not constitute legal advice.
  • F47 Data Provenance Initiative — About, /about: note documented · field
    We collect self-reported licenses from the papers and repositories that released these datasets and categorize them according to our best efforts as a volunteer research and transparency initiative. Information provided by our work and outputs of the Data Provenance Initiative does not constitute legal advice
  • PE-16 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], negative_tags[0] documented
    NOT legal advice (its own notice)
  • PE-17 provenance-census Provenance meta-aggregator census (provenanceerasure.org/aggregators/), record data-provenance-initiative, compiled 2026 Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'data-provenance-initiative'], negative_tags[1] stipulation
    describing a collection does not establish which model used it
  • CAP-1-08 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[3] s2 documented
    'NOT legal advice' and 'describing a collection does not establish which model used it' are not composed; the composition does not claim otherwise.
21.#725 states the bound in its canonical claim, that existing frameworks "address the artifact (C2PA / Content Credentials) and the corpus (Data Provenance Initiative, EU AI Act transparency provisions, W3C PROV)" and "are not designed to address the survival of authorial lineage through AI synthesis": the Initiative "audits whether datasets were licensed, not whether synthesized outputs preserve attribution to the human sources whose labor the synthesis depended upon," stands at "Layer 2 (licensing)," "Necessary but operates on corpus, not synthesis output," and licensing provenance "operates at corpus-ingestion stage" (#725).4
  • D725-01 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · Canonical Claim stipulation
    Existing provenance frameworks address the artifact (C2PA / Content Credentials) and the corpus (Data Provenance Initiative, EU AI Act transparency provisions, W3C PROV). They are not designed to address the survival of authorial lineage through AI synthesis.
  • D725-04 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §0 ¶ 'Existing frameworks are not designed to detect this' stipulation
    The Data Provenance Initiative audits whether datasets were licensed, not whether synthesized outputs preserve attribution to the human sources whose labor the synthesis depended upon.
  • D725-10 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §4 Disambiguation Matrix, row 'Data Provenance Initiative (DPI)' stipulation
    | Data Provenance Initiative (DPI) | Academic audit of training-dataset licenses | Layer 2 (licensing) | Necessary but operates on corpus, not synthesis output |
  • O725-11 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §1.4 The Three Dimensions ¶2 stipulation
    Licensing provenance (DPI, EU AI Act Article 50, Recitals 105-106, Article 53 opt-out signaling, W3C PROV) audits whether *this dataset* was used with *this permission* under *this license*. It is necessary but operates at corpus-ingestion stage.
22."Licensing audits operate on the input to AI systems. They do not address the output" (#725, emphasis dropped): "The Data Provenance Initiative tells you whether the dataset was licensed," and none of the instruments "was designed to tell you what happened to the meaning between the camera and the screen, between the dataset and the answer"; the path from the Initiative runs through "dataset licensing" to "what about what the model produces from the licensed data?" and so to semantic provenance, which extends provenance "to the lifecycle of the meaning the content carries," with the Initiative as "layer 2 of" provenance after AI (#725).5
  • D725-08 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §3.2 Misreading: provenance as licensing-only, Correction s1–4 stipulation
    Licensing audits operate on the *input* to AI systems. They do not address the *output*. A model trained on properly licensed scholarship can still produce outputs that erase the scholarship's lineage. Licensing provenance and semantic provenance are different problems requiring different instruments.
  • D725-09 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §11 Closing Claim ¶1 stipulation
    The Data Provenance Initiative tells you whether the dataset was licensed. EU AI Act transparency provisions tell you whether the content was AI-generated. None of these instruments was designed to tell you what happened to the meaning between the camera and the screen, between the dataset and the answer, between the source and the synthesis.
  • R725-12 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §5.1 Inward paths, third stipulation
    Data Provenance Initiative → dataset licensing → **what about what the model produces from the licensed data?** → **semantic provenance**
  • O725-07 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §0 ¶ 'Semantic provenance names the dimension' stipulation
    **Semantic provenance** names the dimension that completes the C2PA ambition of trust in digital content by extending provenance from the moment of creation to the lifecycle of the meaning the content carries.
  • R725-13 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §7 Canonical Edge Table, row 'DPI / EU AI Act Article 50' stipulation
    | DPI / EU AI Act Article 50 | is layer 2 of | provenance after AI | Locates licensing/disclosure |
23.#1003 groups the Initiative with C2PA and W3C PROV as "Provenance and attribution studies" that "have focused on attribution loss in AI outputs" (#1003), a reading composed beside #725's bound at the input.1
  • D1003-01 #1003 AI-Native Intellectual Biography: Genre, Provenance, and the Archive That Outpaced Its Author Description (as recorded b Sharks, Lee · 2026-05-21 · ¶ 'Provenance and attribution studies' stipulation
    **Provenance and attribution studies** in digital environments — C2PA, the Data Provenance Initiative, W3C PROV — have focused on attribution loss in AI outputs.
24.#98 tables the Initiative (MIT) as documenting "provenance of popular AI training datasets," a "Documentation project, not infrastructure," and Consent in Crisis as a "Diagnostic paper," in the pattern "They diagnose the crisis or build narrow fixes"; it sets the Initiative at "L4: Provenance / Consent," where what is missing is "Integrated provenance in training pipeline," and records the archive's own provenance schema as taken from it, "Implemented (in CHA)" (#98).5
  • D98-01 #98 Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic Lee Sharks · 2026-05-07 · § D. Data Provenance and Consent, table row 1 stipulation
    | Data Provenance Initiative (MIT) | Documents provenance of popular AI training datasets | Documentation project, not infrastructure |
  • D98-02 #98 Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic Lee Sharks · 2026-05-07 · § D. Data Provenance and Consent, table row 2 stipulation
    | "Consent in Crisis" (Longpre et al., 2024) | Audit of C4, RefinedWeb, Dolma; documents collapse of web-consent infrastructure | Diagnostic paper |
  • D98-05 #98 Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic Lee Sharks · 2026-05-07 · § D. Data Provenance and Consent, 'Pattern' stipulation
    Pattern: They diagnose the crisis or build narrow fixes. None build general infrastructure for *contribution as participation in collective intelligence*.
  • O98-03 #98 Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic Lee Sharks · 2026-05-07 · The Stack, the layer table, row L4 stipulation
    | L4: Provenance / Consent | Where did this come from | Data Provenance Initiative, DECORAIT (narrow) | Integrated provenance in training pipeline |
  • R98-04 #98 Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic Lee Sharks · 2026-05-07 · the component table, row 'Provenance schema' documented
    | Provenance schema | Data Provenance Initiative | Training-pipeline provenance | Implemented (in CHA) |
25.#1714 draws the requirement, "Provenance has to survive the training pipeline," and "Sources can be recorded at ingestion, the record kept with the training set," with the Initiative's literature bearing "on whether slushing is a fixed property of pipelines" (#1714); #95 names "training-data provenance records" among the companion infrastructure for parametric claims, which PER reaches "only indirectly" (#95), and #623 calls standardized documentation of training-data provenance "a step toward the accounting the framework demands" (#623).5
  • D1714-02 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · §9.2 s1–2 stipulation
    Provenance has to survive the training pipeline. The pipeline is a built thing, and the slushing is a property of how it is built.
  • D1714-03 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · §9.2 s5–6 stipulation
    Neither recovers authorship, and both show that what survives depends on what is recorded and computed. Sources can be recorded at ingestion, the record kept with the training set, and a result released with the dependencies its producer can report
  • D1714-04 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · revision note, the research pass stipulation
    the provenance and attribution literature in machine learning (the Data Provenance Initiative; influence functions), which bears on whether slushing is a fixed property of pipelines (§9.2).
  • O95-01 #95 Provenance Alignment: Attribution Survival as a Substrate Condition for Safe AI Knowledge Composition Lee Sharks · 2026-05-05 · § the typology of source-dependent claims (parametric claims) stipulation
    Parametric claims are drawn from the model's training-time parameters rather than runtime retrieval, often without surface signal indicating which sources materially contributed; PER applies to these only indirectly, and addressing them at the substrate level requires companion infrastructure (training-data provenance records, watermarking, content credentials).
  • O623-01 #623 Semantic Infrastructure: From Tim Berners-Lee to the Semantic Economy — Bridging Technical and Political-Economic Framew Lee Sharks · 2026-04-01 · §8.3, final sentence stipulation
    Gebru et al.'s proposal for "datasheets for datasets" — standardized documentation of training data provenance — is a step toward the accounting the framework demands.
26.The home page lists coverage by "the Financial Times, The New York Times, The Washington Post, MIT Technology Review, IEEE Spectrum, and VentureBeat" and citation in "public AI safety and governance reporting" (dataprovenance.org); Wikipedia has no article on it (Wikipedia, 2026-10-29); #725 predicted that broad queries "will be dominated by C2PA/CAI publications, DPI papers, and major media for the foreseeable future" (#725).3
  • F10 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Policy and governance relevance'; 'Featured coverage' documented · field
    Our work has been cited in public AI safety and governance reporting and used to ground debates about data transparency, consent, and market concentration. … DPI findings have been covered by the Financial Times, The New York Times, The Washington Post, MIT Technology Review, IEEE Spectrum, and VentureBeat.
  • F44 Wikipedia — Data Provenance Initiative (no article), Wikipedia: title Data_Provenance_Initiative documented · field
    raw wikitext (action=raw, redirect=no): HTTP 404 … Wikipedia does not have an article with this exact name. … There were no results matching the query.
  • D725-14 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §9 Temporal expectations ¶1 hypothesis
    Ring 4-5 broad-category queries on competitive policy terms will be dominated by C2PA/CAI publications, DPI papers, and major media for the foreseeable future.
27.At the bare name on Google's AI Overview the Capture Registry reads the composition first as identifying "the project," listing "its tools" and reporting "what its audits found, from its own site, its paper and the press," then finds that its "'multi-institutional research project—led in part by researchers from MIT'" "follows the MIT Sloan card," that "the composition names no one" ("MIT named; no person; no identifier"), and that "no card cites" the census record, which "landed on provenanceerasure.org the same day" (Capture Registry, 2026-10-29).5
  • CAP-1-09 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, reading s2 interpretation
    The Overview identifies the project, lists its tools and reports what its audits found, from its own site, its paper and the press.
  • CAP-1-03 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[1] s2 documented
    The record quotes the initiative's own description, 'a multi-disciplinary volunteer effort'; the composition's 'multi-institutional research project—led in part by researchers from MIT' follows the MIT Sloan card.
  • CAP-1-04 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, findings[1] s3 documented
    The record names the founding paper's authors (Shayne Longpre and 16 others); the composition names no one.
  • CAP-1-13 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, per_note documented
    MIT named; no person; no identifier; the initiative's home page and paper cited.
  • CAP-1-12 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry data-provenance-initiative-aio-20261029 (OBS-118fbafa73c9, AXN:0ACD.CAPTURE. Lee Sharks (the registry) · 2026-10-29 · data-provenance-initiative-aio-20261029, q_kind documented
    A baseline: the record landed on provenanceerasure.org the same day (commit 8a9f153) and no card cites it.

the compression: AIO's interaction grammar (lede, headed clusters, bolded labels, card rail), composed from the v0.9 plan in one claim space; it faces on the card, with AIO's transcript a record within it. Composed under v0.9, equal case (ρ = extends): KO_B sentences surviving 0 of 13; every field claim carried. composed 2026-10-29 from the v0.9 knowledge object; not frozen

Compression · The field's ontology — L_F(B)Data Provenance Initiative

Data Provenance Initiative is a volunteer collective of AI researchers auditing AI training data, since its 2023 audit of 1,800+ text datasets, and now four public measurement systems (its pages; arXiv).

🗂️ What it is

  • Operator: volunteers; MIT researchers among the founders (MIT Sloan).3↘
    The Data Provenance Initiative describes itself as "a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI" (README) and as "a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI" (About page).§1 MIT Sloan says researchers "including professor Sandy Pentland and others from MIT" created it (MIT Sloan, 2025), and it releases "papers, datasets, and dashboards" for reasoning "from shared evidence" (home page).§2 Its work began with training data provenance and now also covers web consent, open model markets, concentration of power and real-world use; the home page calls it "Public measurement infrastructure for AI data, model ecosystems, and real-world AI use," with four public measurement systems (About page; home page).§3
  • Data provenance: "sourcing, creation and licensing heritage" (Nature MI).1↘
    Its authors define data provenance as a dataset's "sourcing, creation and licensing heritage, as well as its characteristics" (Nature), traced from source and creators through licence conditions to subsequent use (arXiv; home page).§6

🧾 Origin and extent

  • Founding audit: 1,858 datasets, 44 collections (arXiv, 2023; Nature MI, 2024).1↘
    The founding audit, by Shayne Longpre and 16 other authors (arXiv:2310.16787, 25 October 2023; Nature Machine Intelligence, 30 August 2024), traced 1800+ text datasets, 1,858 in 44 collections, the Data Provenance Collection of its first release (arXiv; Nature; README; MIT Sloan).§5
  • Tools: the Explorer and the Card (arXiv; README).1↘
    It released the audit with an interactive UI, the Data Provenance Explorer, and a Data Provenance Card, "symbolic attribution for all constituent datasets" (arXiv; Nature; README; MIT Sloan).§7
  • Now: 4,000+ datasets, 14,000 domains, 851k models, 23,158 conversations.2↘
    Its work began with training data provenance and now also covers web consent, open model markets, concentration of power and real-world use; the home page calls it "Public measurement infrastructure for AI data, model ecosystems, and real-world AI use," with four public measurement systems (About page; home page).§3 The systems are the Data Provenance Explorer (4,000+ datasets, 608 languages), the Web Consent Explorer (14,000 domains), Open Model Evolution (851k open models) and The AI Observatory (23,158 conversations) (home page).§4
  • Later audits: Consent in Crisis; the multimodal audit.1↘
    Later audits followed: Consent in Crisis (NeurIPS 2024) and four thousand text, speech and video datasets (ICLR 2025), with work on open models and real-world use (home page; MIT Sloan).§11

🔎 Findings

  • Licences: omission 70%+, errors 50%+ (arXiv); 66% recategorized (Nature MI).1↘
    The audit found licence omission of 70%+ and error rates of 50%+ on hosting sites, a "crisis in misattribution" (arXiv), with over 70% of GitHub and Hugging Face licences unspecified and 66% of Hugging Face licences in another use category, "licence laundering" (Nature).§8
  • Divide and skew: closed data holds creative and low-resource data; Western skew.2↘
    85% of licences request attribution and 30% share-alike; closed datasets hold lower-resource languages and creative tasks; in 2023 non-commercial licences spiked to 61%, and 45% of such datasets are synthetic (Nature; arXiv; home page).§9 Representation skews Western, and untraced data risks regulatory non-compliance and copyright exposure (Nature; MIT Sloan).§10
  • Limits: not legal advice; self-reported licences.1↘
    Its outputs do not constitute legal advice, and its licences are self-reported, categorized by best efforts (README; Nature; About page).§12
  • Reception: press coverage; no Wikipedia article.1↘
    The press has covered it, and Wikipedia has no article (home page; Wikipedia).§13
1what it is: a volunteer collective auditing AI dataMIT Sloan — Bringing transparency to the data used to train artificial intelligence4 claims · B1, B3, B5, B7
  • F40 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    The Data Provenance Initiative is a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI.
  • F45 Data Provenance Initiative — About, /about (xh): ¶1 documented · field
    We are a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI.
  • F23 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body ¶4 documented · field
    A team of multidisciplinary researchers, including professor Sandy Pentland and others from MIT, created the Data Provenance Initiative to tackle the data transparency challenge head-on.
  • F9 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Public-interest infrastructure' documented · field
    DPI releases papers, datasets, and dashboards that help researchers, journalists, policymakers, and builders reason from shared evidence.
2its extent now: public measurement infrastructure for AI data, models and useData Provenance Initiative — About4 claims · B1, B7
  • F46 Data Provenance Initiative — About, /about (xh): ¶1 documented · field
    Our work began with training data provenance: tracing datasets from origin to creation, cataloging sources, licenses, creators, and documentation practices. It now also covers web consent, open model markets, concentration of power, and how people use AI systems in practice.
  • F1 Data Provenance Initiative — Data Provenance Initiative (home), served HTML: meta description documented · field
    Public measurement infrastructure for AI data, model ecosystems, and real-world AI use.
  • F2 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): hero documented · field
    Public evidence for accountable AI … DPI maps the datasets, web policies, model markets, and real-world AI uses that shape how AI systems are built and governed.
  • F3 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Flagship systems' documented · field
    Four public measurement systems … Together they trace AI from source data and web consent to model markets and real-world use.
3the term: data provenance, its relations and its unitarXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI3 claims · B1, B2, B4
  • F30 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶3 documented · field
    In this work, we term the combination of these indicators, including a dataset’s sourcing, creation and licensing heritage, as well as its characteristics, the ‘data provenance’.
  • F18 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    We develop tools and standards to trace the lineage of these datasets, from their source, creators, series of license conditions, properties, and subsequent use.
  • F15 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Training Data Provenance' documented · field
    Training Data Provenance … Dataset audits … Trace the sources, licenses, creators, languages, geographies, and derivation chains behind public AI training datasets.
4the founding audit: 44 collections, 1,800+ text datasets (2023)arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI5 claims · B2, B4, B5
  • F16 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, abstract page header documented · field
    [Submitted on 25 Oct 2023 (v1), last revised 4 Nov 2023 (this version, v3)] … The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI … by Shayne Longpre and 16 other authors
  • F17 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    we convene a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets.
  • F31 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶6 documented · field
    As a first contribution of the initiative, we audit 44 instruction or ‘alignment’ finetuning data collections composed of 1,858 individual datasets
  • F41 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    Through a large scale audit of 44 data collections, spanning 1800+ finetuning text-to-text datasets, referred to as the Data Provenance Collection, this initiative's first release thoroughly documents their web and machine sources, licenses, creators, and other metadata.
  • F29 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, article header documented · field
    Published: 30 August 2024 … Nature Machine Intelligence … volume 6, pages 975–987 (2024)
5the Explorer, the Collection and the CardarXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI4 claims · B2, B3, B4, B5
  • F22 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    we release our entire audit, with an interactive UI, the Data Provenance Explorer, which allows practitioners to trace and filter on data provenance for the most popular open source finetuning data collections
  • F34 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, contributions, second documented · field
    The Data Provenance Explorer (DPExplorer) (www.dataprovenance.org), an open-source repository for downloading, filtering and exploring data provenance and characteristics. Our tools auto-generate data provenance cards for scalable symbolic attribution and future documentation best practices.
  • F42 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    Generating a subset of data from this repository will create a `Data Provenance Card`---symbolic attribution for all constituent datasets, that can be used as structured documentation.
  • F25 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'two key actions', second documented · field
    Practitioners can also use the tool to generate a human-readable data provenance card for datasets
6the four systems and their countsData Provenance Initiative — Data Provenance Initiative (home)5 claims · B1
  • F4 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Data Provenance Explorer' (constant xr) documented · field
    Data Provenance Explorer … Training data … 4,000+ datasets … 608 languages across text, speech, and video … Inspect dataset sources, licenses, creators, geographies, modalities, and derivation chains.
  • F5 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Web Consent Explorer' documented · field
    Web Consent Explorer … Web data … 14,000 domains … Terms, robots.txt, and crawl restrictions … Track how web consent signals are changing as AI developers compete for training data.
  • F6 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Open Model Evolution' documented · field
    Open Model Evolution … Model ecosystem … 851k open models … 2.2B downloads and 200+ model attributes … Monitor concentration, participation, transparency, and technical shifts in open-weight AI.
  • F7 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'The AI Observatory' documented · field
    The AI Observatory … Real-world use … 23,158 conversations … 85,633 turns from 7 public sources … Compare how people use and misuse AI systems across sources, models, and contexts.
  • F8 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): metrics strip (constant br) documented · field
    4,000+ … datasets audited … 14,000 … web domains tracked … 851k … open models measured … 23,158 … AI conversations annotated
7the later audits: consent, multimodal, models, useMIT Sloan — Bringing transparency to the data used to train artificial intelligence4 claims · B1, B3
  • F11 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, 'Consent in Crisis' documented · field
    Consent in Crisis: The Rapid Decline of the AI Data Commons … An audit of terms, restrictions, and consent signals across the web. … NeurIPS 2024
  • F12 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, the multimodal audit documented · field
    Bridging the Data Provenance Gap Across Text, Speech, and Video … An audit of four thousand public text, speech, and video datasets. … ICLR 2025
  • F13 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, the model economy and real-world use documented · field
    The AI Observatory: A Public Measure of Real-World AI Use … NeurIPS 2026 … Economies of Open Intelligence: Tracing Power and Participation in the Model Ecosystem … Preprint
  • F28 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body, closing ¶ before the quote documented · field
    While the group’s efforts are currently focused on the data provenance of text, the plan is to expand to other media, such as video, as well as domain-specific data
8audit findings: licence omission and error on hosting sitesarXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI5 claims · B2, B3, B4
  • F24 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'two key actions', first documented · field
    Conducted a systematic audit of more than 1,800 text datasets. The researchers traced the lineage of fine-tuning datasets from 44 of the most widely used text data collections. They found that licenses were frequently miscategorized, with error rates greater than 50% and license information omission rates of more than 70%.
  • F20 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    We also observe frequent miscategorization of licenses on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+.
  • F21 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    This points to a crisis in misattribution and informed use of the most popular datasets driving many recent breakthroughs.
  • F32 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶5 documented · field
    Notably, we find that more than 70% of licences for popular datasets on GitHub and Hugging Face are ‘unspecified’ … our rigorous re-annotation of licences finds that 66% of analysed Hugging Face licences were in a different use category, often labelled as more permissive than the author’s original licence.
  • F33 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶5 documented · field
    Our work highlights a crisis in licence laundering and informed usage of popular datasets
9audit findings: attribution and share-alike requestedNature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI1 claim · B4
  • F35 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, licence findings documented · field
    In total, 85% of dataset licences request attribution, and 30% include a share-alike clause
10audit findings: the commercial divide, the non-commercial spike, synthetic dataarXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI4 claims · B1, B2, B4
  • F19 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    Our landscape analysis highlights the sharp divides in composition and focus of commercially open vs closed datasets, with closed datasets monopolizing important categories: lower resource languages, more creative tasks, richer topic variety, newer and more synthetic training data.
  • F36 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, 'In 2023 there was a spike in NC/A-O dataset licences' documented · field
    In 2023 there was a spike in NC/A-O dataset licences … in 2023, when many of the most popular and diverse datasets were published, the NC/A-O rate is 61%.
  • F37 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, licence-category comparison documented · field
    Table 3 also shows a full 45% of NC/A-O datasets are synthetic, compared to <14% in more permissive licence categories.
  • F14 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): findings strip documented · field
    Data transparency … Open weights now outpace truly open-source models … Dataset restrictions … Source content often carries stricter terms than dataset releases … Real-use heterogeneity … No single public conversation source generalizes across AI use
11audit findings: the language and Western skewNature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI2 claims · B3, B4
  • F38 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, 'Language representation is heavily skewed …' documented · field
    we find a stark Western-centric skew in representation.
  • F27 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'other issues', second documented · field
    Language used in the datasets is heavily skewed toward English and Western European languages, with sparse coverage of languages from Asian, African, and South American nations, if at all.
12the risks it addressesMIT Sloan — Bringing transparency to the data used to train artificial intelligence1 claim · B3
  • F26 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body ¶2 documented · field
    Without transparency into the lineage of data used for artificial intelligence models, researchers, businesses, and other intended users may find themselves out of compliance with emerging regulations like the European Union’s AI Act or exposed to legal and copyright risks.
13stated limits: not legal advice; self-reported licencesNature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI3 claims · B4, B5, B7
  • F43 Data Provenance Initiative — Data-Provenance-Collection README, 'Legal Notice and Limitations' documented · field
    The information provided on this page and any output of the Data Provenance Initiative does not, and is not intended to, constitute legal advice; instead, all information, content, and materials are for general informational purposes only.
  • F39 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Methods, 'Licence annotation process' documented · field
    Note that this protocol reflects best efforts to verify self-reported licences and does not constitute legal advice.
  • F47 Data Provenance Initiative — About, /about: note documented · field
    We collect self-reported licenses from the papers and repositories that released these datasets and categorize them according to our best efforts as a volunteer research and transparency initiative. Information provided by our work and outputs of the Data Provenance Initiative does not constitute legal advice
14reception: press, the encyclopedia, the composition layerData Provenance Initiative — Data Provenance Initiative (home)2 claims · B1, B6
  • F10 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Policy and governance relevance'; 'Featured coverage' documented · field
    Our work has been cited in public AI safety and governance reporting and used to ground debates about data transparency, consent, and market concentration. … DPI findings have been covered by the Financial Times, The New York Times, The Washington Post, MIT Technology Review, IEEE Spectrum, and VentureBeat.
  • F44 Wikipedia — Data Provenance Initiative (no article), Wikipedia: title Data_Provenance_Initiative documented · field
    raw wikitext (action=raw, redirect=no): HTTP 404 … Wikipedia does not have an article with this exact name. … There were no results matching the query.
Expansion · The field's ontology — L_F(B)13 sentences · every one sourced below

The Data Provenance Initiative

The Data Provenance Initiative describes itself as "a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI" (README) and as "a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI" (About page). MIT Sloan says researchers "including professor Sandy Pentland and others from MIT" created it (MIT Sloan, 2025), and it releases "papers, datasets, and dashboards" for reasoning "from shared evidence" (home page). Its work began with training data provenance and now also covers web consent, open model markets, concentration of power and real-world use; the home page calls it "Public measurement infrastructure for AI data, model ecosystems, and real-world AI use," with four public measurement systems (About page; home page).

The systems are the Data Provenance Explorer (4,000+ datasets, 608 languages), the Web Consent Explorer (14,000 domains), Open Model Evolution (851k open models) and The AI Observatory (23,158 conversations) (home page). The founding audit, by Shayne Longpre and 16 other authors (arXiv:2310.16787, 25 October 2023; Nature Machine Intelligence, 30 August 2024), traced 1800+ text datasets, 1,858 in 44 collections, the Data Provenance Collection of its first release (arXiv; Nature; README; MIT Sloan). Its authors define data provenance as a dataset's "sourcing, creation and licensing heritage, as well as its characteristics" (Nature), traced from source and creators through licence conditions to subsequent use (arXiv; home page).

It released the audit with an interactive UI, the Data Provenance Explorer, and a Data Provenance Card, "symbolic attribution for all constituent datasets" (arXiv; Nature; README; MIT Sloan). The audit found licence omission of 70%+ and error rates of 50%+ on hosting sites, a "crisis in misattribution" (arXiv), with over 70% of GitHub and Hugging Face licences unspecified and 66% of Hugging Face licences in another use category, "licence laundering" (Nature). 85% of licences request attribution and 30% share-alike; closed datasets hold lower-resource languages and creative tasks; in 2023 non-commercial licences spiked to 61%, and 45% of such datasets are synthetic (Nature; arXiv; home page).

Representation skews Western, and untraced data risks regulatory non-compliance and copyright exposure (Nature; MIT Sloan). Later audits followed: Consent in Crisis (NeurIPS 2024) and four thousand text, speech and video datasets (ICLR 2025), with work on open models and real-world use (home page; MIT Sloan). Its outputs do not constitute legal advice, and its licences are self-reported, categorized by best efforts (README; Nature; About page). The press has covered it, and Wikipedia has no article (home page; Wikipedia).

Provenance — every sentence sourced13 sentences

13 sentences; 47 field claims, 0 archive claims. Modality is the source's own; the prose carries it in its grammar.

1.The Data Provenance Initiative describes itself as "a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI" (README) and as "a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI" (About page).2
  • F40 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    The Data Provenance Initiative is a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI.
  • F45 Data Provenance Initiative — About, /about (xh): ¶1 documented · field
    We are a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI.
2.MIT Sloan says researchers "including professor Sandy Pentland and others from MIT" created it (MIT Sloan, 2025), and it releases "papers, datasets, and dashboards" for reasoning "from shared evidence" (home page).2
  • F23 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body ¶4 documented · field
    A team of multidisciplinary researchers, including professor Sandy Pentland and others from MIT, created the Data Provenance Initiative to tackle the data transparency challenge head-on.
  • F9 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Public-interest infrastructure' documented · field
    DPI releases papers, datasets, and dashboards that help researchers, journalists, policymakers, and builders reason from shared evidence.
3.Its work began with training data provenance and now also covers web consent, open model markets, concentration of power and real-world use; the home page calls it "Public measurement infrastructure for AI data, model ecosystems, and real-world AI use," with four public measurement systems (About page; home page).4
  • F46 Data Provenance Initiative — About, /about (xh): ¶1 documented · field
    Our work began with training data provenance: tracing datasets from origin to creation, cataloging sources, licenses, creators, and documentation practices. It now also covers web consent, open model markets, concentration of power, and how people use AI systems in practice.
  • F1 Data Provenance Initiative — Data Provenance Initiative (home), served HTML: meta description documented · field
    Public measurement infrastructure for AI data, model ecosystems, and real-world AI use.
  • F2 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): hero documented · field
    Public evidence for accountable AI … DPI maps the datasets, web policies, model markets, and real-world AI uses that shape how AI systems are built and governed.
  • F3 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Flagship systems' documented · field
    Four public measurement systems … Together they trace AI from source data and web consent to model markets and real-world use.
4.The systems are the Data Provenance Explorer (4,000+ datasets, 608 languages), the Web Consent Explorer (14,000 domains), Open Model Evolution (851k open models) and The AI Observatory (23,158 conversations) (home page).5
  • F4 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Data Provenance Explorer' (constant xr) documented · field
    Data Provenance Explorer … Training data … 4,000+ datasets … 608 languages across text, speech, and video … Inspect dataset sources, licenses, creators, geographies, modalities, and derivation chains.
  • F5 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Web Consent Explorer' documented · field
    Web Consent Explorer … Web data … 14,000 domains … Terms, robots.txt, and crawl restrictions … Track how web consent signals are changing as AI developers compete for training data.
  • F6 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'Open Model Evolution' documented · field
    Open Model Evolution … Model ecosystem … 851k open models … 2.2B downloads and 200+ model attributes … Monitor concentration, participation, transparency, and technical shifts in open-weight AI.
  • F7 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): system card 'The AI Observatory' documented · field
    The AI Observatory … Real-world use … 23,158 conversations … 85,633 turns from 7 public sources … Compare how people use and misuse AI systems across sources, models, and contexts.
  • F8 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): metrics strip (constant br) documented · field
    4,000+ … datasets audited … 14,000 … web domains tracked … 851k … open models measured … 23,158 … AI conversations annotated
5.The founding audit, by Shayne Longpre and 16 other authors (arXiv:2310.16787, 25 October 2023; Nature Machine Intelligence, 30 August 2024), traced 1800+ text datasets, 1,858 in 44 collections, the Data Provenance Collection of its first release (arXiv; Nature; README; MIT Sloan).6
  • F16 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, abstract page header documented · field
    [Submitted on 25 Oct 2023 (v1), last revised 4 Nov 2023 (this version, v3)] … The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI … by Shayne Longpre and 16 other authors
  • F17 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    we convene a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets.
  • F31 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶6 documented · field
    As a first contribution of the initiative, we audit 44 instruction or ‘alignment’ finetuning data collections composed of 1,858 individual datasets
  • F41 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    Through a large scale audit of 44 data collections, spanning 1800+ finetuning text-to-text datasets, referred to as the Data Provenance Collection, this initiative's first release thoroughly documents their web and machine sources, licenses, creators, and other metadata.
  • F29 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, article header documented · field
    Published: 30 August 2024 … Nature Machine Intelligence … volume 6, pages 975–987 (2024)
  • F24 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'two key actions', first documented · field
    Conducted a systematic audit of more than 1,800 text datasets. The researchers traced the lineage of fine-tuning datasets from 44 of the most widely used text data collections. They found that licenses were frequently miscategorized, with error rates greater than 50% and license information omission rates of more than 70%.
6.Its authors define data provenance as a dataset's "sourcing, creation and licensing heritage, as well as its characteristics" (Nature), traced from source and creators through licence conditions to subsequent use (arXiv; home page).3
  • F30 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶3 documented · field
    In this work, we term the combination of these indicators, including a dataset’s sourcing, creation and licensing heritage, as well as its characteristics, the ‘data provenance’.
  • F18 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    We develop tools and standards to trace the lineage of these datasets, from their source, creators, series of license conditions, properties, and subsequent use.
  • F15 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Training Data Provenance' documented · field
    Training Data Provenance … Dataset audits … Trace the sources, licenses, creators, languages, geographies, and derivation chains behind public AI training datasets.
7.It released the audit with an interactive UI, the Data Provenance Explorer, and a Data Provenance Card, "symbolic attribution for all constituent datasets" (arXiv; Nature; README; MIT Sloan).4
  • F22 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    we release our entire audit, with an interactive UI, the Data Provenance Explorer, which allows practitioners to trace and filter on data provenance for the most popular open source finetuning data collections
  • F34 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, contributions, second documented · field
    The Data Provenance Explorer (DPExplorer) (www.dataprovenance.org), an open-source repository for downloading, filtering and exploring data provenance and characteristics. Our tools auto-generate data provenance cards for scalable symbolic attribution and future documentation best practices.
  • F42 Data Provenance Initiative — Data-Provenance-Collection README, README ¶1 documented · field
    Generating a subset of data from this repository will create a `Data Provenance Card`---symbolic attribution for all constituent datasets, that can be used as structured documentation.
  • F25 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'two key actions', second documented · field
    Practitioners can also use the tool to generate a human-readable data provenance card for datasets
8.The audit found licence omission of 70%+ and error rates of 50%+ on hosting sites, a "crisis in misattribution" (arXiv), with over 70% of GitHub and Hugging Face licences unspecified and 66% of Hugging Face licences in another use category, "licence laundering" (Nature).4
  • F20 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    We also observe frequent miscategorization of licenses on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+.
  • F21 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    This points to a crisis in misattribution and informed use of the most popular datasets driving many recent breakthroughs.
  • F32 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶5 documented · field
    Notably, we find that more than 70% of licences for popular datasets on GitHub and Hugging Face are ‘unspecified’ … our rigorous re-annotation of licences finds that 66% of analysed Hugging Face licences were in a different use category, often labelled as more permissive than the author’s original licence.
  • F33 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Introduction ¶5 documented · field
    Our work highlights a crisis in licence laundering and informed usage of popular datasets
9.85% of licences request attribution and 30% share-alike; closed datasets hold lower-resource languages and creative tasks; in 2023 non-commercial licences spiked to 61%, and 45% of such datasets are synthetic (Nature; arXiv; home page).5
  • F35 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, licence findings documented · field
    In total, 85% of dataset licences request attribution, and 30% include a share-alike clause
  • F19 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI, Abstract documented · field
    Our landscape analysis highlights the sharp divides in composition and focus of commercially open vs closed datasets, with closed datasets monopolizing important categories: lower resource languages, more creative tasks, richer topic variety, newer and more synthetic training data.
  • F36 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, 'In 2023 there was a spike in NC/A-O dataset licences' documented · field
    In 2023 there was a spike in NC/A-O dataset licences … in 2023, when many of the most popular and diverse datasets were published, the NC/A-O rate is 61%.
  • F37 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, licence-category comparison documented · field
    Table 3 also shows a full 45% of NC/A-O datasets are synthetic, compared to <14% in more permissive licence categories.
  • F14 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): findings strip documented · field
    Data transparency … Open weights now outpace truly open-source models … Dataset restrictions … Source content often carries stricter terms than dataset releases … Real-use heterogeneity … No single public conversation source generalizes across AI use
10.Representation skews Western, and untraced data risks regulatory non-compliance and copyright exposure (Nature; MIT Sloan).3
  • F38 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, 'Language representation is heavily skewed …' documented · field
    we find a stark Western-centric skew in representation.
  • F27 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, 'other issues', second documented · field
    Language used in the datasets is heavily skewed toward English and Western European languages, with sparse coverage of languages from Asian, African, and South American nations, if at all.
  • F26 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body ¶2 documented · field
    Without transparency into the lineage of data used for artificial intelligence models, researchers, businesses, and other intended users may find themselves out of compliance with emerging regulations like the European Union’s AI Act or exposed to legal and copyright risks.
11.Later audits followed: Consent in Crisis (NeurIPS 2024) and four thousand text, speech and video datasets (ICLR 2025), with work on open models and real-world use (home page; MIT Sloan).4
  • F11 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, 'Consent in Crisis' documented · field
    Consent in Crisis: The Rapid Decline of the AI Data Commons … An audit of terms, restrictions, and consent signals across the web. … NeurIPS 2024
  • F12 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, the multimodal audit documented · field
    Bridging the Data Provenance Gap Across Text, Speech, and Video … An audit of four thousand public text, speech, and video datasets. … ICLR 2025
  • F13 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): publications, the model economy and real-world use documented · field
    The AI Observatory: A Public Measure of Real-World AI Use … NeurIPS 2026 … Economies of Open Intelligence: Tracing Power and Participation in the Model Ecosystem … Preprint
  • F28 MIT Sloan — Bringing transparency to the data used to train artificial intelligence, article body, closing ¶ before the quote documented · field
    While the group’s efforts are currently focused on the data provenance of text, the plan is to expand to other media, such as video, as well as domain-specific data
12.Its outputs do not constitute legal advice, and its licences are self-reported, categorized by best efforts (README; Nature; About page).3
  • F43 Data Provenance Initiative — Data-Provenance-Collection README, 'Legal Notice and Limitations' documented · field
    The information provided on this page and any output of the Data Provenance Initiative does not, and is not intended to, constitute legal advice; instead, all information, content, and materials are for general informational purposes only.
  • F39 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI, Methods, 'Licence annotation process' documented · field
    Note that this protocol reflects best efforts to verify self-reported licences and does not constitute legal advice.
  • F47 Data Provenance Initiative — About, /about: note documented · field
    We collect self-reported licenses from the papers and repositories that released these datasets and categorize them according to our best efforts as a volunteer research and transparency initiative. Information provided by our work and outputs of the Data Provenance Initiative does not constitute legal advice
13.The press has covered it, and Wikipedia has no article (home page; Wikipedia).2
  • F10 Data Provenance Initiative — Data Provenance Initiative (home), home (Cr): 'Policy and governance relevance'; 'Featured coverage' documented · field
    Our work has been cited in public AI safety and governance reporting and used to ground debates about data transparency, consent, and market concentration. … DPI findings have been covered by the Financial Times, The New York Times, The Washington Post, MIT Technology Review, IEEE Spectrum, and VentureBeat.
  • F44 Wikipedia — Data Provenance Initiative (no article), Wikipedia: title Data_Provenance_Initiative documented · field
    raw wikitext (action=raw, redirect=no): HTTP 404 … Wikipedia does not have an article with this exact name. … There were no results matching the query.

popup — the compression from the field ledger alone (cards, own pages, Wikipedia). With no archive claim admitted, the entry is the Initiative at its own resolution: its pages, its papers, its README, MIT Sloan. composed 2026-10-29 from the field ledger alone; not frozen

Form ledger — AIO against both arms, at both levels
AIO (T)L_F compressionL_F expansionL_A compressionL_A expansion
body words1901244193532136
distinct claims94747110110
claims per 100 words4.737.911.231.25.1
field claims carried (of 47)—47474747
archive claims0006363
rail4 documents14 lineagesper sentence17 lineagesper sentence
modality shown innonetypographygrammartypographygrammar

Computed from the row at build: words counted in the text; claims from the ledger ids each line or sentence carries. T's claims are the worked example's T1–T9.

The objects

Tthe transcript190 words · 4 cards

register entry data-provenance-initiative-aio-20261029 OBS-118fbafa73c9 · file as first run sha256 d70390cc1cbc82e6…

  • T1-1 definition: 'a multi-institutional research project—led in part by researchers from MIT—that audits the datasets, licenses, and web domains used to train artificial intelligence models' (two markers, one of them the Initiative's inline link)
  • T1-2 Data Provenance Explorer: 'An interactive tool that audits and filters over 1,800+ text and fine-tuning datasets across dozens of collections to inspect sources, lineages, and license types.'
  • T1-3 Web Consent Explorer: 'A system that tracks thousands of web domains for consent signals and web policies.'
  • T1-4 Open Model Evolution: 'A monitor tracking open-source and open-weight AI models for transparency and concentration.'
  • T1-5 AI Observatory: 'A comparative tool for analyzing real-world AI conversation sets.' (three markers for the tools block)
  • T1-6 licence omission and errors: 'Widely used hosting platforms exhibit over a 70% license omission rate and more than 50% error rates in how they categorize dataset licenses.' (one marker)
  • T1-7 composition divides: 'Commercially closed or restrictive datasets often monopolize creative tasks, specialized topics, and lower-resource languages.' (one marker)
  • T1-8 non-commercial spikes: 'There has been a significant rise in non-commercial and academic-only licenses, frequently driven by synthetic data generated via commercial APIs.' (one marker, a token that occurs nowhere else in the answer)
  • T1-9 closer: 'Would you like to explore how to use the Data Provenance Explorer, or look into specific dataset licenses?'
Bthe disclosed field7 sources
  • B1 Data Provenance Initiative — Data Provenance Initiative (home) card; HTTP 200, B1.html sha256 bf609f385257c3a1; text from the script bundle (site-main.af19d7fc.js)
  • B2 arXiv — [2310.16787] The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI card; HTTP 200, B2.html sha256 d01552052066b391
  • B3 MIT Sloan — Bringing transparency to the data used to train artificial intelligence card; HTTP 200, B3.html sha256 563661c73ddce481
  • B4 Nature Machine Intelligence — A large-scale audit of dataset licensing and attribution in AI card; HTTP 200, B4.html sha256 766eb441fb2e78db
  • B5 Data Provenance Initiative — Data-Provenance-Collection README own_page; the census's saved copy (read 2026-10-29, HTTP 200), B5.html sha256 db4c35a5f4f2b17a; not refetched
  • B6 Wikipedia — Data Provenance Initiative (no article) no article: raw HTTP 404, rendered HTTP 404 (one 429 retried), search no results; sha256 64f4d986f0e9aa62
  • B7 Data Provenance Initiative — About own_page; HTTP 200, B7.html sha256 bf609f385257c3a1; text from the script bundle (site-main.af19d7fc.js)
Ethe two entities and their relationρ = extends · equal case

E_A, the archive's entity: the same initiative in the provenance census record and the archive's deposits: an audit collection and explorer that records provenance, its object a fine-tuning dataset traced through its collection to its sources, its carrier audit metadata and the Data Provenance Card, its count the first release's; the corpus (licensing) dimension of provenance beside the artifact and the semantic, bounded at the input of AI systems (it 'tells you whether the dataset was licensed'); a documentation project, not infrastructure, from which the archive took its provenance schema; and the training-pipeline end of the requirement that provenance survive the pipeline PE-04 PE-05 PE-06 PE-08 PE-10 PE-22 O725-03 O725-05 D725-01 D725-04 D725-09 D725-10 D98-01 R98-04 D1714-02 O95-01 CAP-1-10; defining papers #725, #98, #1714, #1003, #95, #623

E_F, the field's entity (type C — a conventional reading holds it (public entity: a research initiative, a volunteer collective of AI researchers, with its audit collection, explorer and card, now four public measurement systems)): the Data Provenance Initiative, a volunteer collective of AI researchers (its words) whose first release audited 44 fine-tuning collections and 1,800+ text datasets (arXiv:2310.16787, 25 October 2023; Nature Machine Intelligence, 30 August 2024), defining data provenance as a dataset's sourcing, creation and licensing heritage, released as the Data Provenance Collection, Explorer and Card, and which now runs four public measurement systems (datasets, web consent, open models, real-world use); its findings licence omission of 70%+ and error of 50%+ on hosting sites, a commercial divide and a Western skew; its outputs not legal advice

ρ = extends: the archive reads E_F as the entity and adds senses, mechanisms and limits on the field's own object: the census's formalization (its question, kind, capability, object, unit, carrier, negative tags); the licensing dimension of provenance among three independent dimensions, with its bound at the corpus and the input; the Initiative as a documentation project at L4 from which the archive adopted its provenance schema; and the requirement that provenance survive the training pipeline. Nothing in E_A denies a field claim; #725 states its relation to the frameworks it names as 'Extension and completion, not substitution or critique'. PE-22 PE-04 PE-06 O725-03 O725-05 O725-06 D725-01 D725-04 D725-08 D725-10 D98-01 R98-04 D1714-02 D1003-01. Guard: ρ = extends claims an addition and no more: #725's bound ('audits whether datasets were licensed, not whether synthesized outputs preserve attribution') is a limit on the Initiative's scope, stated as not a critique of its adequacy in its own domain ('The packet's claim is not that the existing frameworks fail'); #1003's grouping of it with studies of attribution loss in outputs is composed beside #725's under P_coh, within the one ontology; the census's two statements of the explorer relation are composed together, neither ruled.

The case: equal terms, ontology included (v0.9). The archive's account extends the field's ontology. The field gives the Initiative as its own pages and papers give it (a volunteer collective, its audits, its tools, its findings, its limits) and the census formalizes that same entity, every field with a quote from a saved copy of the entity's own pages; #725 names its relation to the Initiative as extension, not substitution or critique, and supplies the dimension the Initiative was not designed for without contesting what it is. No ontology here is available only from the archive, so the law of the suppressed witness does not apply (§0.10): one claim space, nothing translated (§4.1, §4.3).

#725 header, Relation: Extension and completion, not substitution or critique

#725 header, Governing Doctrine: The aim is to extend the existing frameworks by naming the dimension they were not designed to address.

#725 §1.4 ¶4: The packet's claim is not that the existing frameworks fail. It is that they were not designed for the dimension proposed here.

#PE census.json organizing_question: What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?

τthe translation: every field claim carried, beside its statement in the archive's ontology47 field claims · 14 rows
field claimsreceivedreceiving texttranslationarchive
F9, F23, F40, F45F9 (B1, home (Cr): 'Public-interest infrastructure'): "DPI releases papers, datasets, and dashboards that help researchers, journalists, policymakers, and builders reason from shared evidence."; F23 (B3, article body ¶4): "A team of multidisciplinary researchers, including professor Sandy Pentland and others from MIT, created the Data Provenance Initiative to tackle the data transparency challenge head-on."; F40 (B5, README ¶1): "The Data Provenance Initiative is a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI."; F45 (B7, /about (xh): ¶1): "We are a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI."—untranslated: composed as received beside PE-02, PE-03, PE-04PE-02, PE-03, PE-04
F1, F2, F3, F46F1 (B1, served HTML: meta description): "Public measurement infrastructure for AI data, model ecosystems, and real-world AI use."; F2 (B1, home (Cr): hero): "Public evidence for accountable AI … DPI maps the datasets, web policies, model markets, and real-world AI uses that shape how AI systems are built and governed."; F3 (B1, home (Cr): 'Flagship systems'): "Four public measurement systems … Together they trace AI from source data and web consent to model markets and real-world use."; F46 (B7, /about (xh): ¶1): "Our work began with training data provenance: tracing datasets from origin to creation, cataloging sources, licenses, creators, and documentation practices. It now also covers web consent, open model markets, concentration of power, and how people use AI systems in practice."—untranslated: composed as received beside CAP-1-10CAP-1-10
F15, F18, F30F15 (B1, home (Cr): 'Training Data Provenance'): "Training Data Provenance … Dataset audits … Trace the sources, licenses, creators, languages, geographies, and derivation chains behind public AI training datasets."; F18 (B2, Abstract): "We develop tools and standards to trace the lineage of these datasets, from their source, creators, series of license conditions, properties, and subsequent use."; F30 (B4, Introduction ¶3): "In this work, we term the combination of these indicators, including a dataset’s sourcing, creation and licensing heritage, as well as its characteristics, the ‘data provenance’."—untranslated: composed as received beside PE-05, PE-06, PE-07, PE-09, PE-22, O725-03, O725-05, O725-06, O725-15PE-05, PE-06, PE-07, PE-09, PE-22, O725-03, O725-05, O725-06, O725-15
F16, F17, F29, F31, F41F16 (B2, abstract page header): "[Submitted on 25 Oct 2023 (v1), last revised 4 Nov 2023 (this version, v3)] … The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI … by Shayne Longpre and 16 other authors"; F17 (B2, Abstract): "we convene a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets."; F29 (B4, article header): "Published: 30 August 2024 … Nature Machine Intelligence … volume 6, pages 975–987 (2024)"; F31 (B4, Introduction ¶6): "As a first contribution of the initiative, we audit 44 instruction or ‘alignment’ finetuning data collections composed of 1,858 individual datasets"; F41 (B5, README ¶1): "Through a large scale audit of 44 data collections, spanning 1800+ finetuning text-to-text datasets, referred to as the Data Provenance Collection, this initiative's first release thoroughly documents their web and machine sources, licenses, creators, and other metadata."—untranslated: composed as received beside PE-10, PE-15PE-10, PE-15
F22, F25, F34, F42F22 (B2, Abstract): "we release our entire audit, with an interactive UI, the Data Provenance Explorer, which allows practitioners to trace and filter on data provenance for the most popular open source finetuning data collections"; F25 (B3, 'two key actions', second): "Practitioners can also use the tool to generate a human-readable data provenance card for datasets"; F34 (B4, contributions, second): "The Data Provenance Explorer (DPExplorer) (www.dataprovenance.org), an open-source repository for downloading, filtering and exploring data provenance and characteristics. Our tools auto-generate data provenance cards for scalable symbolic attribution and future documentation best practices."; F42 (B5, README ¶1): "Generating a subset of data from this repository will create a Data Provenance Card---symbolic attribution for all constituent datasets, that can be used as structured documentation."—untranslated: composed as received beside PE-01, PE-08, PE-13, PE-18, PE-19PE-01, PE-08, PE-13, PE-18, PE-19
F4, F5, F6, F7, F8F4 (B1, home (Cr): system card 'Data Provenance Explorer' (constant xr)): "Data Provenance Explorer … Training data … 4,000+ datasets … 608 languages across text, speech, and video … Inspect dataset sources, licenses, creators, geographies, modalities, and derivation chains."; F5 (B1, home (Cr): system card 'Web Consent Explorer'): "Web Consent Explorer … Web data … 14,000 domains … Terms, robots.txt, and crawl restrictions … Track how web consent signals are changing as AI developers compete for training data."; F6 (B1, home (Cr): system card 'Open Model Evolution'): "Open Model Evolution … Model ecosystem … 851k open models … 2.2B downloads and 200+ model attributes … Monitor concentration, participation, transparency, and technical shifts in open-weight AI."; F7 (B1, home (Cr): system card 'The AI Observatory'): "The AI Observatory … Real-world use … 23,158 conversations … 85,633 turns from 7 public sources … Compare how people use and misuse AI systems across sources, models, and contexts."; F8 (B1, home (Cr): metrics strip (constant br)): "4,000+ … datasets audited … 14,000 … web domains tracked … 851k … open models measured … 23,158 … AI conversations annotated"—untranslated: composed as received beside CAP-1-05, CAP-1-06, CAP-1-07, CAP-1-11, PE-14, PE-20CAP-1-05, CAP-1-06, CAP-1-07, CAP-1-11, PE-14, PE-20
F11, F12, F13, F28F11 (B1, home (Cr): publications, 'Consent in Crisis'): "Consent in Crisis: The Rapid Decline of the AI Data Commons … An audit of terms, restrictions, and consent signals across the web. … NeurIPS 2024"; F12 (B1, home (Cr): publications, the multimodal audit): "Bridging the Data Provenance Gap Across Text, Speech, and Video … An audit of four thousand public text, speech, and video datasets. … ICLR 2025"; F13 (B1, home (Cr): publications, the model economy and real-world use): "The AI Observatory: A Public Measure of Real-World AI Use … NeurIPS 2026 … Economies of Open Intelligence: Tracing Power and Participation in the Model Ecosystem … Preprint"; F28 (B3, article body, closing ¶ before the quote): "While the group’s efforts are currently focused on the data provenance of text, the plan is to expand to other media, such as video, as well as domain-specific data"—untranslated: composed as received beside PE-20PE-20
F20, F21, F24, F32, F33F20 (B2, Abstract): "We also observe frequent miscategorization of licenses on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+."; F21 (B2, Abstract): "This points to a crisis in misattribution and informed use of the most popular datasets driving many recent breakthroughs."; F24 (B3, 'two key actions', first): "Conducted a systematic audit of more than 1,800 text datasets. The researchers traced the lineage of fine-tuning datasets from 44 of the most widely used text data collections. They found that licenses were frequently miscategorized, with error rates greater than 50% and license information omission rates of more than 70%."; F32 (B4, Introduction ¶5): "Notably, we find that more than 70% of licences for popular datasets on GitHub and Hugging Face are ‘unspecified’ … our rigorous re-annotation of licences finds that 66% of analysed Hugging Face licences were in a different use category, often labelled as more permissive than the author’s original licence."; F33 (B4, Introduction ¶5): "Our work highlights a crisis in licence laundering and informed usage of popular datasets"—untranslated: composed as received beside PE-11, PE-12, PE-21, D725-16, D1714-01, CAP-1-01, CAP-1-02PE-11, PE-12, PE-21, D725-16, D1714-01, CAP-1-01, CAP-1-02
F35F35 (B4, licence findings): "In total, 85% of dataset licences request attribution, and 30% include a share-alike clause"—untranslated: composed as received beside D725-02D725-02
F14, F19, F36, F37F14 (B1, home (Cr): findings strip): "Data transparency … Open weights now outpace truly open-source models … Dataset restrictions … Source content often carries stricter terms than dataset releases … Real-use heterogeneity … No single public conversation source generalizes across AI use"; F19 (B2, Abstract): "Our landscape analysis highlights the sharp divides in composition and focus of commercially open vs closed datasets, with closed datasets monopolizing important categories: lower resource languages, more creative tasks, richer topic variety, newer and more synthetic training data."; F36 (B4, 'In 2023 there was a spike in NC/A-O dataset licences'): "In 2023 there was a spike in NC/A-O dataset licences … in 2023, when many of the most popular and diverse datasets were published, the NC/A-O rate is 61%."; F37 (B4, licence-category comparison): "Table 3 also shows a full 45% of NC/A-O datasets are synthetic, compared to <14% in more permissive licence categories."—untranslated: composed as received (no archive claim stands in this lineage)
F27, F38F27 (B3, 'other issues', second): "Language used in the datasets is heavily skewed toward English and Western European languages, with sparse coverage of languages from Asian, African, and South American nations, if at all."; F38 (B4, 'Language representation is heavily skewed …'): "we find a stark Western-centric skew in representation."—untranslated: composed as received (no archive claim stands in this lineage)
F26F26 (B3, article body ¶2): "Without transparency into the lineage of data used for artificial intelligence models, researchers, businesses, and other intended users may find themselves out of compliance with emerging regulations like the European Union’s AI Act or exposed to legal and copyright risks."—untranslated: composed as received (no archive claim stands in this lineage)
F39, F43, F47F39 (B4, Methods, 'Licence annotation process'): "Note that this protocol reflects best efforts to verify self-reported licences and does not constitute legal advice."; F43 (B5, 'Legal Notice and Limitations'): "The information provided on this page and any output of the Data Provenance Initiative does not, and is not intended to, constitute legal advice; instead, all information, content, and materials are for general informational purposes only."; F47 (B7, /about: note): "We collect self-reported licenses from the papers and repositories that released these datasets and categorize them according to our best efforts as a volunteer research and transparency initiative. Information provided by our work and outputs of the Data Provenance Initiative does not constitute legal advice"—untranslated: composed as received beside PE-16, PE-17, CAP-1-08PE-16, PE-17, CAP-1-08
F10, F44F10 (B1, home (Cr): 'Policy and governance relevance'; 'Featured coverage'): "Our work has been cited in public AI safety and governance reporting and used to ground debates about data transparency, consent, and market concentration. … DPI findings have been covered by the Financial Times, The New York Times, The Washington Post, MIT Technology Review, IEEE Spectrum, and VentureBeat."; F44 (B6, Wikipedia: title Data_Provenance_Initiative): "raw wikitext (action=raw, redirect=no): HTTP 404 … Wikipedia does not have an article with this exact name. … There were no results matching the query."—untranslated: composed as received beside D725-14, CAP-1-03, CAP-1-04, CAP-1-09, CAP-1-12, CAP-1-13D725-14, CAP-1-03, CAP-1-04, CAP-1-09, CAP-1-12, CAP-1-13

equal-terms case: every field claim composed as received, beside the archive claims it stands with. Reading the received column recovers the field (§5.9).

R7the measure0 of 13 survive

v0.9 §4.10: KO_B sentences surviving in the KO at similarity ≥ 0.95, with positions (computed as apply_v09.py does: difflib.SequenceMatcher ratio, the best KO sentence for each KO_B sentence): v0.9 0 of 13 (positions [None, None, None, None, None, None, None, None, None, None, None, None, None]; composed first under v0.9, so there is no v0.7 object to measure against). Opening-run check (§5.10): no breach.

L_F(B)recomposed from the disclosed field, in the field's ontology419 words

The Data Provenance Initiative describes itself as "a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI" (README) and as "a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI" (About page). MIT Sloan says researchers "including professor Sandy Pentland and others from MIT" created it (MIT Sloan, 2025), and it releases "papers, datasets, and dashboards" for reasoning "from shared evidence" (home page). Its work began with training data provenance and now also covers web consent, open model markets, concentration of power and real-world use; the home page calls it "Public measurement infrastructure for AI data, model ecosystems, and real-world AI use," with four public measurement systems (About page; home page). The systems are the Data Provenance Explorer (4,000+ datasets, 608 languages), the Web Consent Explorer (14,000 domains), Open Model Evolution (851k open models) and The AI Observatory (23,158 conversations) (home page). The founding audit, by Shayne Longpre and 16 other authors (arXiv:2310.16787, 25 October 2023; Nature Machine Intelligence, 30 August 2024), traced 1800+ text datasets, 1,858 in 44 collections, the Data Provenance Collection of its first release (arXiv; Nature; README; MIT Sloan). Its authors define data provenance as a dataset's "sourcing, creation and licensing heritage, as well as its characteristics" (Nature), traced from source and creators through licence conditions to subsequent use (arXiv; home page). It released the audit with an interactive UI, the Data Provenance Explorer, and a Data Provenance Card, "symbolic attribution for all constituent datasets" (arXiv; Nature; README; MIT Sloan). The audit found licence omission of 70%+ and error rates of 50%+ on hosting sites, a "crisis in misattribution" (arXiv), with over 70% of GitHub and Hugging Face licences unspecified and 66% of Hugging Face licences in another use category, "licence laundering" (Nature). 85% of licences request attribution and 30% share-alike; closed datasets hold lower-resource languages and creative tasks; in 2023 non-commercial licences spiked to 61%, and 45% of such datasets are synthetic (Nature; arXiv; home page). Representation skews Western, and untraced data risks regulatory non-compliance and copyright exposure (Nature; MIT Sloan). Later audits followed: Consent in Crisis (NeurIPS 2024) and four thousand text, speech and video datasets (ICLR 2025), with work on open models and real-world use (home page; MIT Sloan). Its outputs do not constitute legal advice, and its licences are self-reported, categorized by best efforts (README; Nature; About page). The press has covered it, and Wikipedia has no article (home page; Wikipedia).

L_A(B ∪ A)the field and the archive composed in the archive's ontology2136 words

The Data Provenance Initiative is, in its repository's words, "a multi-disciplinary volunteer effort to improve transparency, documentation, and responsible use of training datasets for AI," and on its About page "a volunteer collective of AI researchers conducting large-scale audits of the systems and resources that shape modern AI" (README; dataprovenance.org/about); the provenance census record gives its operator as the Initiative itself, a "volunteer effort" with a "paper by Shayne Longpre and 16 other authors," kinds it an "audit collection and explorer" and sets it in the lineage of "training data" (provenance census record). MIT Sloan's account has "a team of multidisciplinary researchers, including professor Sandy Pentland and others from MIT," create the Initiative "to tackle the data transparency challenge head-on" (MIT Sloan, 3 March 2025), and the home page says that "DPI releases papers, datasets, and dashboards that help researchers, journalists, policymakers, and builders reason from shared evidence" (dataprovenance.org). Its work, the About page says, "began with training data provenance: tracing datasets from origin to creation, cataloging sources, licenses, creators, and documentation practices" and "now also covers web consent, open model markets, concentration of power, and how people use AI systems in practice" (dataprovenance.org/about); the home page calls it "Public measurement infrastructure for AI data, model ecosystems, and real-world AI use," which "maps the datasets, web policies, model markets, and real-world AI uses that shape how AI systems are built and governed" through "Four public measurement systems" (dataprovenance.org). The founding audit's authors name its object: "we term the combination of these indicators, including a dataset's sourcing, creation and licensing heritage, as well as its characteristics, the 'data provenance'" (Nature Machine Intelligence, 30 August 2024), traced "from their source, creators, series of license conditions, properties, and subsequent use" (arXiv:2310.16787), and the home page's "Training Data Provenance" traces "the sources, licenses, creators, languages, geographies, and derivation chains behind public AI training datasets" (dataprovenance.org). The provenance census asks of each entity it formalizes "What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?" and answers for the Initiative that it records, of the three capabilities express, record and test: its object "a fine-tuning dataset, traced through its collection to its sources," its unit "a dataset within a collection," its relations derivation, creators, licences and subsequent use, the last field restating the paper's lineage (provenance census record). #725 sets that object in the second dimension of provenance, "training-corpus licensing," which "has academic instrumentation and emerging legal architecture," its object "The corpus" and its question "Under what permissions did this data enter this system?", with the Initiative among its frameworks and among provenance's disciplinary homes as "dataset documentation (DPI, model cards, dataset cards)," and states that the dimensions of artifact, licensing and meaning are independent: "a licensed dataset can produce outputs with excellent semantic provenance if the synthesis preserves attribution" (#725). The founding paper was submitted on 25 October 2023 and revised on 4 November 2023, "by Shayne Longpre and 16 other authors" (arXiv:2310.16787), and published in Nature Machine Intelligence, volume 6, on 30 August 2024 (Nature Machine Intelligence); the census dates the entity from the preprint, "2023 (arXiv:2310.16787, v1 25 October 2023)" (provenance census record). It convened "a multi-disciplinary effort between legal and machine learning experts to systematically audit and trace 1800+ text datasets" (arXiv), in the journal "44 instruction or 'alignment' finetuning data collections composed of 1,858 individual datasets" (Nature Machine Intelligence), the release the repository calls the Data Provenance Collection and "this initiative's first release" (README), and the count the census carries, "44 data collections, 1800+ fine-tuning text-to-text datasets (first release)," as of the README (provenance census record); MIT Sloan gives "more than 1,800 text datasets" from "44 of the most widely used text data collections" (MIT Sloan). With the audit came "an interactive UI, the Data Provenance Explorer, which allows practitioners to trace and filter on data provenance for the most popular open source finetuning data collections" (arXiv), in the journal "an open-source repository for downloading, filtering and exploring data provenance and characteristics" whose tools "auto-generate data provenance cards for scalable symbolic attribution" (Nature Machine Intelligence); the repository's Data Provenance Card is "symbolic attribution for all constituent datasets, that can be used as structured documentation" (README), "human-readable" in MIT Sloan's account (MIT Sloan), and the census carries it as the entity's provenance carrier beside "audit metadata per dataset" (provenance census record). The census gives Data Provenance Explorer, Data Provenance Collection and Data Provenance Card as other names of the entity and states its relation to them twice: among its negative tags, "initiative, explorer and collection are distinct records," and on its sibling relation to the MMRS meta-aggregator's record of the explorer, "the same entity, read for reception there and for provenance carriage here"; it records the Explorer as "a JavaScript application, unreadable to a plain fetch" (provenance census record). The home page's four systems are the Data Provenance Explorer ("4,000+ datasets," "608 languages across text, speech, and video," inspecting "dataset sources, licenses, creators, geographies, modalities, and derivation chains"), the Web Consent Explorer ("14,000 domains," "Terms, robots.txt, and crawl restrictions"), Open Model Evolution ("851k open models," "2.2B downloads") and The AI Observatory ("23,158 conversations," "85,633 turns from 7 public sources") (dataprovenance.org). Its metrics read "4,000+" "datasets audited," "14,000" "web domains tracked," "851k" "open models measured" and "23,158" "AI conversations annotated," and its publications carry the later work: Consent in Crisis (NeurIPS 2024), the multimodal audit, "An audit of four thousand public text, speech, and video datasets" (ICLR 2025), Economies of Open Intelligence (preprint) and The AI Observatory (NeurIPS 2026) (dataprovenance.org); in March 2025 MIT Sloan still had the work "currently focused on the data provenance of text," with a plan "to expand to other media, such as video" (MIT Sloan). The census carries the entity as "active" and lists "the Explorer itself (JavaScript)" and "the multimodal extension (arXiv:2412.17847)" among what it has not yet checked (provenance census record); the Capture Registry finds that "The record has one explorer and the first release's count," that the home-page card gives "four platforms and '4,000+ audited datasets; 14,000 tracked web domains'," that the composition is "ahead of the record on the entity's current extent," and that "The census is to re-read dataprovenance.org and carry the platforms and the current count with their quotes," the capture being "a correction to be made from the entity's own page" (Capture Registry, 2026-10-29). The founding audit observed "frequent miscategorization of licenses on widely used dataset hosting sites, with license omission of 70%+ and error rates of 50%+," which "points to a crisis in misattribution and informed use of the most popular datasets driving many recent breakthroughs" (arXiv), the result the census records as what survived the operation it tested, "dataset repackaging and hosting (licence carried or lost on hosting sites)" (provenance census record). The journal gives the measure by platform, "more than 70% of licences for popular datasets on GitHub and Hugging Face are 'unspecified'" and "66% of analysed Hugging Face licences were in a different use category, often labelled as more permissive than the author's original licence," and names "a crisis in licence laundering" (Nature Machine Intelligence); MIT Sloan restates error rates "greater than 50%" and omission rates "of more than 70%" (MIT Sloan). The Capture Registry checked these figures "against the provenance census record of the same day and the entity pages it saved" and calls the 70%/50% wording "the record's quote from the repository README" (Capture Registry, 2026-10-29), where the census gives it as what "the founding paper reports" (provenance census record). "In total, 85% of dataset licences request attribution, and 30% include a share-alike clause" (Nature Machine Intelligence); #725 carries these figures with the omission and error rates and reads them as the licensing dimension's ground, "The DPI's documentation of 70%+ license-omission rates establishes the licensing dimension's urgency" (#725), and #1714 reads the finding as "how much is lost before training even begins" (#1714). Of the commercial divide the preprint finds "closed datasets monopolizing important categories: lower resource languages, more creative tasks, richer topic variety, newer and more synthetic training data" (arXiv); the journal records that "In 2023 there was a spike in NC/A-O dataset licences," "the NC/A-O rate is 61%" that year, and that "a full 45% of NC/A-O datasets are synthetic, compared to <14% in more permissive licence categories" (Nature Machine Intelligence); the home page's findings are "Source content often carries stricter terms than dataset releases," "Open weights now outpace truly open-source models" and "No single public conversation source generalizes across AI use" (dataprovenance.org). The journal finds "a stark Western-centric skew in representation" (Nature Machine Intelligence), MIT Sloan language "heavily skewed toward English and Western European languages," and MIT Sloan states the stake: without lineage, users "may find themselves out of compliance with emerging regulations like the European Union's AI Act or exposed to legal and copyright risks" (MIT Sloan). Its stated limits: "any output of the Data Provenance Initiative does not, and is not intended to, constitute legal advice" (README); the licence protocol "reflects best efforts to verify self-reported licences and does not constitute legal advice" (Nature Machine Intelligence); "We collect self-reported licenses from the papers and repositories that released these datasets and categorize them according to our best efforts" (dataprovenance.org/about); the census tags it "NOT legal advice (its own notice)" and adds that "describing a collection does not establish which model used it" (provenance census record), and the Capture Registry finds both tags "not composed" at the name (Capture Registry, 2026-10-29). #725 states the bound in its canonical claim, that existing frameworks "address the artifact (C2PA / Content Credentials) and the corpus (Data Provenance Initiative, EU AI Act transparency provisions, W3C PROV)" and "are not designed to address the survival of authorial lineage through AI synthesis": the Initiative "audits whether datasets were licensed, not whether synthesized outputs preserve attribution to the human sources whose labor the synthesis depended upon," stands at "Layer 2 (licensing)," "Necessary but operates on corpus, not synthesis output," and licensing provenance "operates at corpus-ingestion stage" (#725). "Licensing audits operate on the input to AI systems. They do not address the output" (#725, emphasis dropped): "The Data Provenance Initiative tells you whether the dataset was licensed," and none of the instruments "was designed to tell you what happened to the meaning between the camera and the screen, between the dataset and the answer"; the path from the Initiative runs through "dataset licensing" to "what about what the model produces from the licensed data?" and so to semantic provenance, which extends provenance "to the lifecycle of the meaning the content carries," with the Initiative as "layer 2 of" provenance after AI (#725). #1003 groups the Initiative with C2PA and W3C PROV as "Provenance and attribution studies" that "have focused on attribution loss in AI outputs" (#1003), a reading composed beside #725's bound at the input. #98 tables the Initiative (MIT) as documenting "provenance of popular AI training datasets," a "Documentation project, not infrastructure," and Consent in Crisis as a "Diagnostic paper," in the pattern "They diagnose the crisis or build narrow fixes"; it sets the Initiative at "L4: Provenance / Consent," where what is missing is "Integrated provenance in training pipeline," and records the archive's own provenance schema as taken from it, "Implemented (in CHA)" (#98). #1714 draws the requirement, "Provenance has to survive the training pipeline," and "Sources can be recorded at ingestion, the record kept with the training set," with the Initiative's literature bearing "on whether slushing is a fixed property of pipelines" (#1714); #95 names "training-data provenance records" among the companion infrastructure for parametric claims, which PER reaches "only indirectly" (#95), and #623 calls standardized documentation of training-data provenance "a step toward the accounting the framework demands" (#623). The home page lists coverage by "the Financial Times, The New York Times, The Washington Post, MIT Technology Review, IEEE Spectrum, and VentureBeat" and citation in "public AI safety and governance reporting" (dataprovenance.org); Wikipedia has no article on it (Wikipedia, 2026-10-29); #725 predicted that broad queries "will be dominated by C2PA/CAI publications, DPI papers, and major media for the foreseeable future" (#725). At the bare name on Google's AI Overview the Capture Registry reads the composition first as identifying "the project," listing "its tools" and reporting "what its audits found, from its own site, its paper and the press," then finds that its "'multi-institutional research project—led in part by researchers from MIT'" "follows the MIT Sloan card," that "the composition names no one" ("MIT named; no person; no identifier"), and that "no card cites" the census record, which "landed on provenanceerasure.org the same day" (Capture Registry, 2026-10-29).

Δthe delta

T against L_F(B) (AIO's ontology at work on its own cards): At 'Data Provenance Initiative' (T1, four cards: B1–B4; 190 words) the composition gives the Initiative by its home page, its paper, MIT Sloan and the journal paper. Composed from its cards: the four systems (B1 F3–F7: the Data Provenance Explorer, the Web Consent Explorer, Open Model Evolution, the AI Observatory), at coarser grain (F5's 14,000 domains as 'thousands'; F6's and F7's counts dropped); the founding audit's licence finding at the source's grain (B2 F20 'license omission of 70%+ and error rates of 50%+', restated by B3 F24); the commercial divide (B2 F19, 'more creative tasks' and 'lower resource languages' kept, 'richer topic variety' as 'specialized topics'); the Explorer's 'interactive' and its lineage fields (B2 F22, F18). Substituted reading, the operator: the cards give the Initiative's own home page and paper, whose self-description the composition does not take (B1 F1–F2, 'Public measurement infrastructure', 'maps the datasets, web policies, model markets'), and the own pages not surfaced call it a 'volunteer effort' and a 'volunteer collective' (B5 F40, B7 F45); T composes 'a multi-institutional research project—led in part by researchers from MIT' from MIT Sloan's 'researchers, including professor Sandy Pentland and others from MIT' (B3 F23), as the Capture Registry finds (CAP-1-03); 'multi-institutional' is in no card's text (the field has 'multidisciplinary', F23, and 'multi-disciplinary', F17). Substituted count: the Explorer is given at the founding audit's scale, 'over 1,800+ text and fine-tuning datasets across dozens of collections' (B2 F17; B4 F31's 44 collections at the coarser 'dozens'), where card 1 gives the Explorer '4,000+ datasets' in '608 languages across text, speech, and video' (B1 F4, F8): the first release stands for the present explorer. Substituted reading, the tool: T has the Explorer 'audit' datasets; in the field the experts audit (F17) and the audit is released 'with an interactive UI, the Data Provenance Explorer' (F22). Force raised: T1-8 composes a cause, 'frequently driven by synthetic data generated via commercial APIs', where the journal reports the 2023 spike (B4 F36) and the synthetic share of non-commercial datasets (F37) side by side; limit dropped: the year (2023) and the rate (61%). Available, not composed: the term data provenance (B4 F30), attribution and share-alike requested (F35), the per-platform measure and 'licence laundering' (F32, F33), the Western skew (F38, F27), the stake (F26), the later audits by name (B1 F11, F12, F13), the home page's own findings (F14), the metrics strip (F8), the authors and dates (F16, F29; CAP-1-04), the Card (F25, F34), the coverage (F10). Limit dropped: B4 F39 ('best efforts … does not constitute legal advice'), on a card; the own pages' F43 and F47 were not surfaced; the Capture Registry records the census's negative tags as 'not composed' and not contradicted (CAP-1-08). Composed without attribution: no person named, MIT named (CAP-1-13), at the coarse grain of an institutional description: recorded; the findings at the source's grain carry card markers and no name: recorded, the marker the attribution the layer gives. Content replaced by use: the closer (T1-9).

v0.9 §0.5: the first diff is ontological and small. T and the field agree on the entity (an initiative auditing AI training data, with four platforms and audit findings); T gives its operator from the press card rather than from its own pages, its explorer at the first release's scale, and a cause the journal does not state. The field's term (data provenance) and its stated limit are left out.

L_F(B) against L_A(B ∪ A) (the intervention): Admission adds, in one claim space with the field's: the provenance census's formalization of the entity (PE-01–PE-22), its organizing question, its kind ('audit collection and explorer'), capability ('records'), object, unit and carrier, its count at the first release with its own unchecked items, its negative tags ('NOT legal advice', 'describing a collection does not establish which model used it', 'initiative, explorer and collection are distinct records') held beside its sibling relation 'the same entity' (PE-18, PE-19, P_coh within the record); the Initiative's place in the licensing dimension of provenance, beside artifact and meaning, the dimensions independent (O725-03, O725-05, O725-15, O725-06); its bound at the corpus and the input (D725-01, D725-04, D725-08–D725-10, O725-11) and the path from it to semantic provenance (R725-12, R725-13, O725-07), held beside #1003's grouping of it with studies of 'attribution loss in AI outputs' (D1003-01); 'Documentation project, not infrastructure', L4, and the archive's own adoption of its provenance schema (D98-01, D98-02, D98-05, O98-03, R98-04); the requirement that provenance survive the training pipeline (D1714-01–04, O95-01, O623-01); #725's prediction that broad queries would compose from DPI papers (D725-14); and the Capture Registry's account of the composition at the name (CAP-1-01–13), including that the composition is ahead of the record on the entity's extent (CAP-1-10) and its ascription of the 70%/50% quote to the README, marked contradicts_primary (CAP-1-01). Not surfaced: every archive source; no card cites the census record or a deposit (CAP-1-12).

alignment: {'T1_cards_claims': ['F1', 'F2', 'F3', 'F4', 'F5', 'F6', 'F7', 'F8', 'F9', 'F10', 'F11', 'F12', 'F13', 'F14', 'F15', 'F16', 'F17', 'F18', 'F19', 'F20', 'F21', 'F22', 'F23', 'F24', 'F25', 'F26', 'F27', 'F28', 'F29', 'F30', 'F31', 'F32', 'F33', 'F34', 'F35', 'F36', 'F37', 'F38', 'F39'], 'T1_composed': ['F3', 'F4', 'F5', 'F6', 'F7', 'F17', 'F18', 'F19', 'F20', 'F22', 'F23', 'F24', 'F31', 'F36', 'F37'], 'T1_outside_cards': ["'multi-institutional' (T1-1): in no field source's text", "'frequently driven by' (T1-8): a causal relation no field source states"], 'rule': "a field claim counts as composed when T states it at its source's grain or coarser; the typology of what is not is in T_vs_LB (§6.2)"}

Kthe prospective kernel sealed only at freeze15 entries
K1D725-04 #725T composes the Initiative's audits and gives no bound
claim
D725-04
source
#725
M_src
stipulation
sense
its bound: the corpus, not the output
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
T composes the Initiative's audits and gives no bound
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K2D725-10 #725T gives no dimension of provenance
claim
D725-10
source
#725
M_src
stipulation
sense
its layer: licensing, necessary but on the corpus
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
T gives no dimension of provenance
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K3O725-05 #725absent from T
claim
O725-05
source
#725
M_src
stipulation
sense
the licensing dimension's object and question
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
absent from T
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K4D725-08 #725absent from T
claim
D725-08
source
#725
M_src
stipulation
sense
licensing audits on the input, not the output
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
absent from T
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K5D1003-01 #1003absent from T
claim
D1003-01
source
#1003
M_src
stipulation
sense
held beside: studies of attribution loss in outputs
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
absent from T
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K6D98-01 #98T: 'a multi-institutional research project'
claim
D98-01
source
#98
M_src
stipulation
sense
a documentation project, not infrastructure
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
T: 'a multi-institutional research project'
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K7R98-04 #98absent from T
claim
R98-04
source
#98
M_src
documented
sense
the archive's adoption of its provenance schema
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
absent from T
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K8D1714-02 #1714absent from T
claim
D1714-02
source
#1714
M_src
stipulation
sense
provenance has to survive the training pipeline
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
absent from T
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K9PE-04 provenance census record, 2026-10-29absent from T
claim
PE-04
source
provenance census record, 2026-10-29
M_src
stipulation
sense
the census's kind: an audit collection and explorer
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
absent from T
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K10PE-06 provenance census record, 2026-10-29T: 'sources, lineages, and license types' (coarse)
claim
PE-06
source
provenance census record, 2026-10-29
M_src
stipulation
sense
what receives provenance: a fine-tuning dataset traced to its sources
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
T: 'sources, lineages, and license types' (coarse)
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K11PE-17 provenance census record, 2026-10-29absent from T
claim
PE-17
source
provenance census record, 2026-10-29
M_src
stipulation
sense
a collection does not establish which model used it
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
absent from T
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K12PE-18 provenance census record, 2026-10-29T composes the explorer as one of the Initiative's tools
claim
PE-18
source
provenance census record, 2026-10-29
M_src
stipulation
sense
initiative, explorer and collection are distinct records
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
T composes the explorer as one of the Initiative's tools
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K13CAP-1-03 Capture Registry, 2026-10-29T: 'led in part by researchers from MIT'
claim
CAP-1-03
source
Capture Registry, 2026-10-29
M_src
documented
sense
the operator from the Initiative's own description
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
T: 'led in part by researchers from MIT'
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K14CAP-1-07 Capture Registry, 2026-10-29T: the first release's 1,800+ for the Explorer
claim
CAP-1-07
source
Capture Registry, 2026-10-29
M_src
stipulation
sense
the count corrected from the home page
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
T: the first release's 1,800+ for the Explorer
resolver
a later capture at 'Data Provenance Initiative' (ADDR-c0bda0b5919d) on Google AI Overview, seated in the Capture Registry (§8.3)
K15D725-14 #725an observation at broad provenance queries, not at this address
claim
D725-14
source
#725
M_src
hypothesis
sense
prediction: broad queries composed from DPI papers
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
an observation at broad provenance queries, not at this address
resolver
later captures at broad provenance queries (e.g. 'what is provenance in the age of AI', #725's Test 8), seated in the Capture Registry (§8.3)
Archive bearing — D/R/O traversalread

Candidates are found by string; admission is by reading.

traversalfirst reading, 2026-10-29; second pass with one citation hop
D 8 deposits · 35 sentencesR 2 · 5O 9 · 18 direct, 9 classhop 73read: 10 admitted, 7 not

Lee Sharks · Crimson Hexagonal Archive · register v1.36, 2026-10-27. Built by scripts/build_non.py from the files linked above; it writes nothing back. Working, not frozen.