The Negative of the Negative › entity olmotrace

One entity of the Negative of the Negative (EA-NEGONT-02, #1690), cited at https://www.alexanarch.org/non/olmotrace/. the table of contents · this entity as data · contents as data · the dataset on the Hub · row json · field ledger · archive ledger · D/R/O traversal · the address page · the provenance meta-aggregator record.

A reader that fetches this page may stop short of its end; the entry's text, every sentence of its knowledge object with the claims it cites and each claim's quote, source and locus, is in entity.json beside it.

OLMoTrace

SPXI instrument · method 0.16 of 87, level 0 (Measurement): The Negative of the Negative (/non). An instrument of SPXI, the Semantic Packet for eXchange & Indexing; the whole practice is itemized at spxi.dev/methods.

type C — a conventional reading holds it (public entity on which the archive bears: a tracing tool; an entity of the provenance meta-aggregator) · sought at OLMoTrace

composed 2026-10-29 under EA-NEGONT-02 v0.9, #1690, equal case, ρ = extends (draft, not frozen; ledgers unaudited, one extractor; checked by the session and the page builder)

AXN AXN:0AE1.NON.🃏☁️○🌲👋△ · root AXN:0AE1.NON

composed in session · Claude (Opus 5.5), subagent, 2026-10-29

This row was composed in session. SPXI-gnΩsis (gnosis.spxi.dev) opens a Wikipedia revision sentence by sentence against the sources it cites; a commission consults the archive by its own procedure and composes the entity's row here; a quote to recompose this entity is free.

Google AI Overview (expanded)epoch 2026-10-29
not frozentype C — a conventional reading holds it (public entity on which the archive bears: a tracing tool; an entity of the provenance meta-aggregator)signed out, incognitoknowledge object · 27 sentences

EA-NEGONT-02 v0.9, #1690: equal case, ρ = extends, read from the provenance census record, the capture record and the deposits that bear on the tool's class (#725, #95, #1075, #127, #1714); archive selected by D/R/O (no D or R candidate: no archive text names the tool; 7 deposits admitted by reading at O-class, 5 with claims and 2 grouped as instances; hop of 77 read and rejected), with the provenance census record (21 claims) and the Capture Registry's findings, reading, analysis and query note (11 claims) ledgered as the archive's records of the entity; the field B by three origins (6 cards, 2 of them unreachable; 1 own page; Wikipedia, no article); the composer read the ledgers, never the transcript, except where the brief asks for T's claims and the delta. Ledger: unaudited (§3.8: one extractor per ledger); field quotes 51/51 verified by script against saved text, the ACL PDF's text, the Wikipedia response summary or the card text; archive quotes 39/39 verified against the registry, census.json and the deposit texts.

WORKING KNOWLEDGE OBJECT · NOT FROZEN · LEDGER UNAUDITED

Current instantiation — composed under EA-NEGONT-02 v0.9 (#1690)

Compression · Field and archive, equal terms — L(B ∪ A)OLMoTrace

OLMoTrace is the Allen Institute for AI's tool, with the University of Washington, UC Berkeley and Stanford, that finds verbatim matches between spans of a language model's output and documents in its full training data, in real time (its paper; census record); its authors state the matched documents are not causes, evidence or citations (the paper).

🔎 What it carries

  • Relation: a verbatim match, one maximal span to the documents containing it, found by lexical overlap (paper; census record).3↘
    Ai2 introduced it on 9 April 2025 as a feature of the Ai2 Playground (Ai2 blog), and the census answers its organizing question for it, "What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?", field by field (census record).§2 The relation it carries is a verbatim match: it "finds and shows verbatim matches between segments of language model output and documents in the training text corpora" (arXiv abstract), highlighting long and unique spans found at least once in the training data (Ai2 blog), which the census records as its one relation type, its operation (model generation traced back to training text) and its unit, "a maximal matching span of model output" (census record).§3 It retrieves "by lexical overlap, with the heuristic that such training examples are likely to be influential for the given output" (the paper, §6); for the class of training-data attribution, which treats model behaviour as counterfactually dependent on the examples that entered training, the archive's protocol ranks exact paired retraining first, validated approximation second, and "unvalidated similarity or intuition only as exploratory evidence" (#1075).§4
  • Carrier: the full training corpus on an extended infini-gram index; 3.2 billion documents, 4.6 trillion tokens for OLMo-2-32B-Instruct (paper; Ai2 blog).2↘
    Its carrier is the model's full training corpus over an extended infini-gram index (census record): for OLMo-2-32B-Instruct, 3.2 billion documents and 4.6 trillion tokens across pre-, mid- and post-training, all of them matched (the paper; Ai2 blog; census record).§5 Span finding runs at O(L * log N) (Ai2 blog); up to 10 enclosing snippets are retrieved per kept span and ranked by BM25 (the paper), a score that conveys "some notion of relevance" (Ai2 blog), behind a "Show OLMoTrace" button below the model's answer (Techzine, snippet only).§6
  • Pipeline: up to 10 snippets per span, BM25-ranked, "some notion of relevance"; 4.46 seconds a query (paper; Ai2 blog).2↘
    Span finding runs at O(L * log N) (Ai2 blog); up to 10 enclosing snippets are retrieved per kept span and ranked by BM25 (the paper), a score that conveys "some notion of relevance" (Ai2 blog), behind a "Show OLMoTrace" button below the model's answer (Techzine, snippet only).§6 Per query the tracing takes 4.46 seconds on average, and the first document it displays averages 1.90 on a 0–3 relevance scale, roughly "on the same topic" as the output, in the paper's own measurement (the paper).§7

🧪 Uses and their conditions

  • Purpose: where models "may have learned to generate certain word sequences" (paper).1↘
    Its purpose, in the paper, is to explore where models "may have learned to generate certain word sequences", verbatim matching taken as "the most direct connection between LM outputs and the training data" (the paper), for researchers, developers and the general public (Ai2 blog), at "an early stage" of exploring the tool (Ai2 blog).§10
  • Uses: fact checking, hallucination, creativity, math; a false knowledge cutoff traced (paper; Ai2 blog).2↘
    Its authors show it on "fact checking, hallucination, and the creativity of language models" (arXiv abstract), with three case studies, fact checking first (the paper), and Ai2's post traces a math expression the model could have learned by memorization and a false knowledge cutoff to post-training examples, a finding that changed the 32B model's post-training data (Ai2 blog).§14 Ai2's leaders tie the tool to hallucination scores, "assuming that the inputs were factual" (Farhadi), and to regulation, governance and auditability (Lebrecht), in the newsletter's report (Ken Yeung).§19
  • Fact checking: users "may be able to" check a statement, once they verify the sources are trusted; Liu's launch statement goes further (paper; Ai2 blog; Ken Yeung).2↘
    Fact checking stands in the paper as a possibility, users "may be able to fact-check the statement against its training data", with its qualification that context and source help "a more informed judgment on the factuality of the statement", since words mislead out of context and some web sources are unreliable (the paper, arXiv v2 and ACL 2025).§15 Ai2's post calls the interpretation of matches "quite nuanced" and makes confidence in a generated fact conditional on the user's own check that the documents "come from trusted sources" (Ai2 blog); the newsletter calls it an application "offering fact-checking", and Liu's launch statement says users "can ensure that the data supporting their outputs is trustworthy and verifiable" (Ken Yeung).§16

⚠️ The stated limit

  • Not causes, evidence or citations: in both versions of the paper; the census's negative tags (paper; ACL 2025; census record).1↘
    The authors state the limit in both versions of the paper, "The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output" (the paper; ACL 2025), and the census carries it as two negative tags, not causes of the output and "NOT a citation system", and in what it records as surviving (census record).§17
  • Associations: not "indicators of authority" (Ai2, to Ken Yeung).1↘
    To the newsletter Ai2 called the documents associations, not "the definitive source of the model's learning", and its results not "indicators of authority" (Ken Yeung).§18

🧭 Its class

  • Training/output: data attribution's relation, where PER measures output/reader (#725).1↘
    The archive places the class this tool belongs to on the training/output relation: data attribution asks "Which training examples shaped a specific output", an adjacent method that "Operates on training/output relation; PER operates on output/reader relation" (#725).§11
  • Partial, at cost: recovers no authorship; one post-hoc layer in isolation (#1714; #127).1↘
    Of that class the archive holds that partial tracing "is possible at cost", that it does not recover authorship, and that "what survives depends on what is recorded and computed" (#1714), and that training-data attribution is the post-hoc detection layer, developed "in isolation" from the other survival layers, no system bundling them (#127).§12
  • Parametric claims: need training-data provenance records (#95; #1714).1↘
    Claims drawn from a model's training-time parameters, on the archive's typology, often carry no surface signal of the sources that contributed; PER reaches them only indirectly, and the substrate level needs companion infrastructure, "training-data provenance records" among it (#95), since provenance "has to survive the training pipeline" (#1714).§13
  • Evidence: similarity is exploratory evidence only (#1075).1↘
    It retrieves "by lexical overlap, with the heuristic that such training examples are likely to be influential for the given output" (the paper, §6); for the class of training-data attribution, which treats model behaviour as counterfactually dependent on the examples that entered training, the archive's protocol ranks exact paired retraining first, validated approximation second, and "unvalidated similarity or intuition only as exploratory evidence" (#1075).§4
  • Not RAG: post hoc, no intervention; Google AI Overview named as RAG (paper).1↘
    The paper sets it apart from retrieval-augmented generation, naming Google AI Overview among RAG's examples: OLMoTrace "retrieves documents post-hoc and does not intervene with the LM generation" (the paper; Liu in Ken Yeung), and Gemini's double-check, drawn from Search and not from Gemini's training data, is "less useful for scientific exploration" (the paper).§20

🏛️ Origin

  • Models: OLMo 2, OLMoE, OLMo 3; any model whose training data the provider holds (Ai2; paper; X).2↘
    At launch it served OLMo 2 32B and 13B Instruct and OLMoE 1B 7B Instruct and "can be applied to any language model for which you have access to the training data" (Ai2 blog), "as long as the service provider has access to its full training data" (the paper); Ai2's post on X gives the OLMo 3 family (X, snippet only), which the Capture Registry finds the census record does not yet carry and is to carry from Ai2's own page (Capture Registry, 2026-10-29).§8 The census tags it as tracing "only models whose training data is open" (census record); Farhadi ties the connection to Ai2's open inputs, and Liu expects closed-model providers to hesitate because the tool would expose their training data (Ken Yeung).§9
  • Published: arXiv April 2025; ACL 2025 Best Demo; open source (arXiv; ACL Anthology).3↘
    Its 31 authors are at the Allen Institute for AI, the University of Washington, UC Berkeley and Stanford (arXiv; the paper), the operator the census records whole (census record), where the composition named Ai2 alone (Capture Registry, 2026-10-29).§23 It is "publicly available and fully open-source" (arXiv abstract), its core under the Apache 2.0 license (the paper), reached through the Ai2 Playground (census record), an expression of Ai2's commitment to "open models, open data, and beyond" (Ai2 blog).§24 Submitted 9 April 2025 and revised 8 July (arXiv; census record), it appeared in ACL 2025's System Demonstrations with the Best Demo award (ACL Anthology), and the census records it active, "ACL 2025 demo track" (census record).§25
  • Assessment: "generating awareness"; exposes problematic training content (Ken Yeung; paper).1↘
    Its authors name as a risk that it makes problematic training content "more easily exposed" (the paper), and the newsletter finds that it gives no analytics for improving the data: "Simply put, it's generating awareness" (Ken Yeung).§26

📝 Record and composition

  • At the name: the Overview offered a match "as support for a claim", naming Ai2 alone (Capture Registry, 2026-10-29).3↘
    At its own name on Google's AI Overview, 2026-10-29, the composition held the tool, its maker, its real time, its scale and its verbatim matching, checked against the census record and the pages it saved, naming the tool, its method, its models and its uses (Capture Registry, 2026-10-29), and gave as its first use "Fact-Checking: Verify whether specific claims in a model's answer are backed by real training documents", a verbatim match "offered as support for a claim, the reading the paper excludes" (Capture Registry, 2026-10-29).§21 The registry reads this as "the conversion of a matching relation into a citation relation that the paper names and refuses", a tool whose authors state what a match does not mean "composed with that meaning restored", and it finds the census record's negative tags to be the authors' own (Capture Registry, 2026-10-29).§22 Its 31 authors are at the Allen Institute for AI, the University of Washington, UC Berkeley and Stanford (arXiv; the paper), the operator the census records whole (census record), where the composition named Ai2 alone (Capture Registry, 2026-10-29).§23
  • Reception: no card cites the census record; no Wikipedia article (Capture Registry; Wikipedia).1↘
    The census records the tool as one that records provenance, a neighbour of the Data Provenance Initiative, with the Playground and "infini-gram as a separate record" left unchecked (census record); no card cites the record, which landed the same day (Capture Registry, 2026-10-29), and Wikipedia has no article on OLMoTrace (Wikipedia, 2026-10-29).§27
1what it is: tracing model output to its training data in real timearXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...4 claims · B1, B2, PE
  • PE-01 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].kind stipulation
    tracing tool
  • PE-02 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].lineage stipulation
    training data
  • F1 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s1 documented · field
    We present OLMoTrace, the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time.
  • F2 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶1 documented · field
    Today we introduce OLMoTrace, a one-of-a-kind feature in the Ai2 Playground that lets you trace the outputs of language models back to their full, multi-trillion-token training data in real time.
2the relation: verbatim match between output and training textarXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...6 claims · B1, B2, B7, PE
  • PE-03 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].provenance_object stipulation
    a span of a language model's output and the training documents that contain it verbatim
  • F3 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s2 documented · field
    OLMoTrace finds and shows verbatim matches between segments of language model output and documents in the training text corpora.
  • F4 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interact with OLMoTrace' ¶1 documented · field
    The highlights indicate long and unique spans that appear verbatim at least once in the training data of this model.
  • PE-04 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].relation_types stipulation
    verbatim match between output and training text
  • PE-10 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].transformations_tested stipulation
    model generation, traced back to training text
  • F5 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 Related Work, 'Tracing LM generation into training data' documented · field
    we directly retrieve similar training examples by lexical overlap, with the heuristic that such training examples are likely to be influential for the given output.
3what the record's schema asksPE4 claims · PE
  • PE-21 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json organizing_question stipulation
    What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?
  • PE-09 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].capability stipulation
    records
  • PE-19 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].unchecked self-description
    the Playground itself
  • PE-20 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].unchecked self-description
    infini-gram as a separate record
4the pipeline: spans, index, retrieval, rankingAllen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai26 claims · B1, B5, B7, PE
  • PE-06 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].unit stipulation
    a maximal matching span of model output
  • PE-05 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].provenance_carrier stipulation
    the model's full training corpus, indexed with an extended infini-gram
  • F9 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶3 documented · field
    reducing the time complexity of span finding from the naive O(L^2 * N) to O(L * log N)
  • F10 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §3 Steps 3 and 5 documented · field
    For each kept span, we retrieve up to 10 document snippets from the training data that enclose this span. … we rank all documents by a BM25 score in descending order.
  • F11 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶7 documented · field
    We find that this BM25 score conveys some notion of “relevance”, and thus we surface documents with higher scores on top.
  • F12 Techzine Global — Ai2 introduces OLMoTrace: a peek inside LLM's - Techzine Global, card snippet (Techzine unreachable: HTTP 403) documented · field
    After generating an answer from OLMo in the Ai2 Playground, users can activate the tool by clicking the “Show OLMoTrace” button below the output.
5the evidentiary hierarchy for training-data attribution#1075 EA-NEGSHAPE-01 v0.2: The Negative Shape of the Work — A Counterfactual · 2026-07-122 claims · #1075
  • O1075-01 #1075 EA-NEGSHAPE-01 v0.2: The Negative Shape of the Work — A Counterfactual Protocol for Measuring Training Inscription, with Lee Sharks · 2026-07-12 · § (the counterfactual protocol), ¶ 'Training-data attribution research already treats' interpretation
    Training-data attribution research already treats model behavior as counterfactually dependent on which examples entered training: influence functions approximate how removing a training example changes a prediction (Koh and Liang)
  • O1075-02 #1075 EA-NEGSHAPE-01 v0.2: The Negative Shape of the Work — A Counterfactual Protocol for Measuring Training Inscription, with Lee Sharks · 2026-07-12 · §9.1 'The evidentiary hierarchy' definition
    Exact paired retraining is the clearest counterfactual measurement. … Approximation must not reverse the hierarchy: (1) exact counterfactual retraining where feasible; (2) validated approximation where impractical; (3) unvalidated similarity or intuition only as exploratory evidence.
6the training data and its countAllen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai23 claims · B1, B7, PE
  • F15 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §2 'The training data.' documented · field
    which totals 3.2 billion documents and 4.6 trillion (Llama-2) tokens
  • F16 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶8 documented · field
    In total, these five datasets contain about 3.2 billion documents and 4.6 trillion tokens, and OLMoTrace matches against all of them.
  • PE-07 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].count attributed
    3.2 billion documents and 4.6 trillion tokens (OLMo-2-32B-Instruct's training data)
7performance and relevancearXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2)2 claims · B7
  • F13 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §3.2 documented · field
    the OLMoTrace inference latency per query is 4.46 seconds
  • F14 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §4 'Validating the relevance rankings' documented · field
    The first document displayed in each conversation received an average relevance score of 1.90 (roughly meaning “being on the same topic as the LM output)
8models and applicabilityAllen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai27 claims · B1, B4, B6, B7, PE, capture-registry
  • F17 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶2 documented · field
    OLMoTrace is available today with our three flagship models: OLMo 2 32B Instruct, OLMo 2 13B Instruct, and OLMoE 1B 7B Instruct, and it can be applied to any language model for which you have access to the training data.
  • F19 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶5 documented · field
    OLMoTrace can be applied to any LM as long as the service provider has access to its full training data.
  • F18 X — Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just ... - X, card title and snippet (X unreachable) documented · field
    Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just see its behavior—you can trace it. For example, you can ask Olmo 3-Think (32B
  • CAP-1-06 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[3] s1–2 documented
    THE MODELS CURRENT. The OLMo 3 family comes from Ai2's post on X; the record's count is OLMo-2-32B-Instruct's training data (3.2 billion documents, 4.6 trillion tokens).
  • CAP-1-07 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[3] s3 stipulation
    The record is to carry OLMo 3 from Ai2's own page.
  • PE-17 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].negative_tags.2 stipulation
    traces only models whose training data is open
  • F20 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace isn't limited to Ai2's model' documented · field
    However, Liu reasons that closed model providers may hesitate to use OLMoTrace because it would expose the training data to sunlight.
9opennessarXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...5 claims · B1, B2, B6, B7, PE
  • F47 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace connects the output to the input' (Farhadi) documented · field
    OLMoTrace connects the output to the input, as simple as that. Because our inputs are open, we could actually connect them,
  • F45 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s6 documented · field
    OLMoTrace is publicly available and fully open-source.
  • F46 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶5 documented · field
    The core part of the system is open-sourced under the Apache 2.0 license.
  • PE-12 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].data_access attributed
    Ai2 Playground; open source
  • F44 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶1 documented · field
    OLMoTrace is a manifestation of Ai2’s commitment to an open ecosystem – open models, open data, and beyond.
10purpose: where a model may have learned a word sequenceAllen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai23 claims · B1, B7
  • F6 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶4 documented · field
    The purpose of OLMoTrace is to give users a tool to explore where LMs may have learned to generate certain word sequences, focusing on verbatim matching as the most direct connection between LM outputs and the training data.
  • F7 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶2 documented · field
    We developed OLMoTrace to enable researchers, developers, and the general public to inspect where and how language models may have learned to generate certain word sequences.
  • F8 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶5 documented · field
    We are still in an early stage in exploring the full potential of this tool
11two relations: training/output and output/reader#725 Provenance After AI Metadata Packet for Disambiguation: From Artifact · 2026-05-081 claim · #725
  • O725-01 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §4 table, 'Adjacent measurement concepts', row 'Data attribution (TRAK, influence functions)' interpretation
    | Data attribution (TRAK, influence functions) | Which training examples shaped a specific output | Adjacent eval method | Operates on training/output relation; PER operates on output/reader relation |
12partial tracing at cost; what survives depends on what is recorded#1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data · 2026-10-272 claims · #1714
  • O1714-01 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · §9.2 s4–5 interpretation
    The attribution literature shows that partial tracing is possible at cost: influence-function methods estimate which training examples most affect a given output (Grosse et al. 2023). Neither recovers authorship, and both show that what survives depends on what is recorded and computed.
  • O1714-02 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · §9.2 s1–2 interpretation
    Provenance has to survive the training pipeline. The pipeline is a built thing, and the slushing is a property of how it is built.
13post-hoc detection: one survival layer, developed in isolation#127 Inscriptions That Survive the Tokenizer: SPXI-TLP v2.2 — The Training- · 2026-05-251 claim · #127
  • O127-01 #127 Inscriptions That Survive the Tokenizer: SPXI-TLP v2.2 — The Training-Layer Provenance Protocol Lee Sharks; operative co-authors Talos Morrow, Rex Fraction, Rebekah Cranes · 2026-05-25 · § Gap 2 — Multi-Layer Provenance Bundling Specification interpretation
    No existing system bundles provenance across all survival layers simultaneously. … Training data attribution handles post-hoc detection. These are developed in isolation, by different teams, with different standards.
14parametric claims and training-data provenance#95 Provenance Alignment: Attribution Survival as a Substrate Condition fo · 2026-05-051 claim · #95
  • O95-01 #95 Provenance Alignment: Attribution Survival as a Substrate Condition for Safe AI Knowledge Composition Lee Sharks · 2026-05-05 · § the typology of source-dependent claims (parametric claims) interpretation
    Parametric claims are drawn from the model's training-time parameters rather than runtime retrieval, often without surface signal indicating which sources materially contributed; PER applies to these only indirectly, and addressing them at the substrate level requires companion infrastructure (training-data provenance records, watermarking, content credentials).
15uses: fact checking, hallucination, creativity, matharXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...5 claims · B1, B2, B6, B7
  • F21 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s5 documented · field
    We showcase how it can be used to explore fact checking, hallucination, and the creativity of language models.
  • F22 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶4 documented · field
    We present three case studies for ways to use OLMoTrace (§ 5 ): (1) fact checking, (2) tracing the LM-generated “creative” expressions, and (3) tracing math capabilities.
  • F31 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶4 documented · field
    OLMoTrace reveals that this entire expression appears multiple times in the training data, so the model could have easily learned it through memorization.
  • F32 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶5 documented · field
    now we can see that the model may have learned to say August 2023 from the post-training examples listed on the right. This finding led us to remove contents containing knowledge cutoff dates from the 32B model’s post-training data.
  • F30 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace connects the output to the input' (Farhadi) documented · field
    And the minute you start linking the generation to an input—assuming that the inputs were factual—then you can start also cooking up scores for hallucination
16fact checking: what a matched document can and cannot showAllen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai27 claims · B1, B3, B6, B7
  • F23 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §5 'Fact checking.' documented · field
    If the LM states a fact, users may be able to fact-check the statement against its training data.
  • F24 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, PDF §5 'Fact checking.' documented · field
    If the LM states a fact, users may be able to fact-check the statement against its training data.
  • F25 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §5 'Fact checking.' ¶2 documented · field
    We note that inspecting the document context and source can help users make a more informed judgment on the factuality of the statement, as words can be misleading out of context, and some web sources may be unreliable.
  • F26 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶1 documented · field
    The interpretation of text matches with training data is quite nuanced. For some highlighted spans in the model response, we can use their corresponding documents to fact check claims made in the spans.
  • F27 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶2 documented · field
    If you personally verify that these documents come from trusted sources, you can gain confidence that this piece of information generated by the model is factually correct.
  • F28 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶1 documented · field
    Called OLMoTrace, it's an open-source application offering fact-checking of information provided in prompt replies.
  • F29 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶2 (Liu, in a statement) documented · field
    anyone using our models can ensure that the data supporting their outputs is trustworthy and verifiable.
17the stated limit: not causes, not evidence, not citationsThe AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info8 claims · B3, B6, B7, PE, capture-registry
  • F34 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), Limitations documented · field
    OLMoTrace finds lexical, verbatim matches between an LM’s output and its training data. The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output.
  • F35 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, PDF, Limitations documented · field
    The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output.
  • PE-15 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].negative_tags.0 attributed
    the retrieved documents are not causes of the output
  • PE-16 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].negative_tags.1 stipulation
    NOT a citation system
  • PE-11 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].retention_results attributed
    returns matching documents within a few seconds; the authors state the matches are not causal and not citations
  • F36 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'Ai2 doesn't intend' (Liu) documented · field
    Ai2 doesn't intend for the documents retrieved to be viewed as the definitive source of the model's learning. "We're just showing you some associations, connections between them. Some of them may warrant a further inspection," Liu clarified.
  • F37 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'In an example where OLMo was asked about the Space Needle' documented · field
    Ai2 asserts that OLMOTrace’s results should not be mistaken as indicators of authority.
  • CAP-1-03 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[1] s2 documented
    The record's negative tags are the authors' own: 'The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output.'
18uses: regulation and auditingThe AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info1 claim · B6
  • F33 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'As we start to look towards regulation' (Lebrecht) documented · field
    As we start to look towards regulation, governance, and auditability, there are certain key sectors right now that are limited in what they can deploy at scale with black-box models,
19unlike retrieval-augmented generationThe AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info3 claims · B6, B7
  • F39 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 'Comparison with RAG.' documented · field
    Examples of them include Bing Chat, Google AI Overview, and Perplexity AI. Despite looking similar, OLMoTrace is fundamentally different from RAG: OLMoTrace retrieves documents post-hoc and does not intervene with the LM generation.
  • F40 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'Liu interjects' (Liu) documented · field
    We are not intervening with the model response. Our response is purely generated by the neural language model.
  • F41 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 'Other types of tracing.' documented · field
    the Gemini App has a “double-check response” feature that highlights parts of the LM response and shows similar results from Google Search, which is updated in real time and thus not identical to Gemini’s training data, making it less useful for scientific exploration.
20the composition at the name: what it heldCAP3 claims · capture-registry
  • CAP-1-01 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[0] s1–2 documented
    THE TOOL HELD. Ai2, real time, multi-trillion tokens and verbatim matching are the paper's: 'OLMoTrace finds and shows verbatim matches between segments of language model output and documents in the training text corpora' (record).
  • CAP-1-02 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[0] s3 documented
    Checked 2026-10-29 against the provenance census record of the same day and the entity pages it saved.
  • CAP-1-10 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, reading s2 interpretation
    The Overview names the tool and its maker, explains how it finds training text in a model's answer, lists the models it covers and what it is good for.
21the composition converts a match into supportCAP3 claims · capture-registry
  • CAP-1-04 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[1] s3–4 interpretation
    The composition's first use is 'Fact-Checking: Verify whether specific claims in a model's answer are backed by real training documents'. A verbatim match is offered as support for a claim, the reading the paper excludes.
  • CAP-1-09 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, analysis s2 interpretation
    The composition turns a trace of verbatim overlap into evidence for a claim, the conversion of a matching relation into a citation relation that the paper names and refuses.
  • CAP-1-08 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, analysis s1 interpretation
    A provenance tool whose authors state precisely what a match does not mean is composed with that meaning restored.
22the operator and the authorsarXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...4 claims · B2, B7, PE, capture-registry
  • F43 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., title and authors documented · field
    View a PDF of the paper titled OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens, by Jiacheng Liu and 30 other authors
  • F42 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), affiliations documented · field
    α Allen Institute for AI ω University of Washington β UC Berkeley σ Stanford University
  • PE-08 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].operator attributed
    Allen Institute for AI (Ai2), with the University of Washington, UC Berkeley and Stanford
  • CAP-1-05 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[2] documented
    THE PARTNERS UNSAID. The record names the University of Washington, UC Berkeley and Stanford with Ai2; the composition names Ai2 alone.
23publicationarXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...4 claims · B2, B3, PE
  • F48 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., submission history; Comments documented · field
    [Submitted on 9 Apr 2025 (v1), last revised 8 Jul 2025 (this version, v2)] … Comments: ACL 2025 demo track
  • PE-14 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].version_and_time documented
    v1": "2025-04-09", "v2": "2025-07-08", "read": "2026-10-29
  • F49 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, Anthology metadata documented · field
    Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations) … Award: Best Demo
  • PE-13 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].lifecycle documented
    state": "active", "detail": "ACL 2025 demo track
24risksarXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2)1 claim · B7
  • F50 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), Mitigating social and legal risks documented · field
    OLMoTrace can make potentially problematic contents in the LM training data more easily exposed.
25assessment from outsideThe AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info1 claim · B6
  • F38 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'While Ai2 touts OLMoTrace' documented · field
    OLMoTrace doesn't provide analytics or insights to help developers determine what to do next to improve the training data. Simply put, it's generating awareness.
26neighbours in the censusPE1 claim · PE
  • PE-18 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].relations stipulation
    rel": "neighbour", "target": "data-provenance-initiative
27reception: the record and the cardsCAP1 claim · capture-registry
  • CAP-1-11 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, q_kind documented
    A baseline: the record landed on provenanceerasure.org the same day (commit 8a9f153) and no card cites it.
28reception: the encyclopediaWikipedia — OLMoTrace (no article)1 claim · B8
  • F51 Wikipedia — OLMoTrace (no article), Wikipedia: titles OLMoTrace and OlmoTrace; article-space search documented · field
    raw wikitext (action=raw, redirect=no), 2026-10-29T17:09:54Z: HTTP 404 … Wikipedia does not have an article with this exact name. … There were no results matching the query.
AIO's transcript, a record · OLMoTrace · Google AI Overview (expanded) · 207 words · 6 cards
[Google AI Overview at the query, signed out and incognito (operator defaults of 2026-10-01 and 2026-10-14), 2026-10-29. The paste is the Overview expanded (the 'AI Mode Conversation' view, with the source cards that follow the answer); the 'You said' line carries the query twice, run together, and is given once here. Inline links are Google redirect URLs, kept as pasted.]

[QUERENT] OLMoTrace

[SYSTEM] [OLMoTrace](https://www.google.com/goto?url=CAESWgHrOzAVoVYHLgJxMVIjxyaZx7wDArKB6jxCb1tOprJFofLF9_o_Lr6foJNzJ2skLWhN04W7o7uFmFuQkrV4xPmu8JuLWWjcOIm7uniqJ_3AgD9QQJlTrCUJTQ) is an open-source system developed by the Allen Institute for Artificial Intelligence (Ai2) that traces language model outputs back to their multi-trillion-token training datasets in real time. [[1](https://www.google.com/goto?url=CAESWgHrOzAVoVYHLgJxMVIjxyaZx7wDArKB6jxCb1tOprJFofLF9_o_Lr6foJNzJ2skLWhN04W7o7uFmFuQkrV4xPmu8JuLWWjcOIm7uniqJ_3AgD9QQJlTrCUJTQ), [2](https://www.google.com/goto?url=CAESWAHrOzAVIeW0Bh-S4A2VvhIfG4x5GI442H2AG7c4YT-P8qSUHih41gNA2d_u0ez62uyi0CLMCuDxp107lq0nGROUCWBCMy5JoGWd2CZ7_vNcWWCs3Lu2iFg)]
How It Works

* Real-Time Tracing: After a model generates a response in the Ai2 Playground, users can click the Show OLMoTrace button to highlight verbatim spans of text. [[1](https://www.google.com/goto?url=CAESkgEB6zswFSw37mmS0ky2JdwMbluTG9bXw6YrEyY7-RDR3C6gpGJF1AjuVzgdHaMhPrwWEs6-CqOPaBUaJmKtgKhm0K6DY4dgamujc7BlSKs3Q7zgBXwn4p50GiZOmvHB7LP_ros68_TLow3I8e5BC6voQvexCU7B9RANXq30erTczX0PJp4Eoot_gOSfIdL-s64rEQ), [2](https://www.google.com/goto?url=CAESWgHrOzAVoVYHLgJxMVIjxyaZx7wDArKB6jxCb1tOprJFofLF9_o_Lr6foJNzJ2skLWhN04W7o7uFmFuQkrV4xPmu8JuLWWjcOIm7uniqJ_3AgD9QQJlTrCUJTQ)]
* Source Retrieval: The tool matches output segments against training corpora (such as the Dolma datasets) and ranks up to 10 context documents using BM25 and unigram probabilities. [[1](https://www.google.com/goto?url=CAESaQHrOzAVV_6J7u0vQR70ckMfNhiCogECpGpN15fGLDhAZkGzPPDHW94cWHDI3yvNEPPIeJCWECt_JJh8NwwM53Wiwyx94U6j_n8S84uLcd-yOdbxGgO2_8_63OmgYRHsjdzAlH-iXL3LIA), [2](https://www.google.com/goto?url=CAESWgHrOzAVoVYHLgJxMVIjxyaZx7wDArKB6jxCb1tOprJFofLF9_o_Lr6foJNzJ2skLWhN04W7o7uFmFuQkrV4xPmu8JuLWWjcOIm7uniqJ_3AgD9QQJlTrCUJTQ)]
* Underlying Tech: It uses an extended version of infini-gram with a parallel algorithm that reduces lookup complexity to \(O(L \log N)\). [[1](https://www.google.com/goto?url=CAESWgHrOzAVoVYHLgJxMVIjxyaZx7wDArKB6jxCb1tOprJFofLF9_o_Lr6foJNzJ2skLWhN04W7o7uFmFuQkrV4xPmu8JuLWWjcOIm7uniqJ_3AgD9QQJlTrCUJTQ)]

Supported Models

* OLMo 2 32B Instruct
* OLMo 2 13B Instruct
* OLMoE 1B 7B Instruct
* OLMo 3 family (including OLMo 3-Think 32B) [[1](https://www.google.com/goto?url=CAESWgHrOzAVoVYHLgJxMVIjxyaZx7wDArKB6jxCb1tOprJFofLF9_o_Lr6foJNzJ2skLWhN04W7o7uFmFuQkrV4xPmu8JuLWWjcOIm7uniqJ_3AgD9QQJlTrCUJTQ), [2](https://www.google.com/goto?url=CAESaQHrOzAVV_6J7u0vQR70ckMfNhiCogECpGpN15fGLDhAZkGzPPDHW94cWHDI3yvNEPPIeJCWECt_JJh8NwwM53Wiwyx94U6j_n8S84uLcd-yOdbxGgO2_8_63OmgYRHsjdzAlH-iXL3LIA)]

Key Use Cases

* Fact-Checking: Verify whether specific claims in a model's answer are backed by real training documents or generated from general parameters. [[1](https://www.google.com/goto?url=CAESWgHrOzAVoVYHLgJxMVIjxyaZx7wDArKB6jxCb1tOprJFofLF9_o_Lr6foJNzJ2skLWhN04W7o7uFmFuQkrV4xPmu8JuLWWjcOIm7uniqJ_3AgD9QQJlTrCUJTQ), [2](https://www.google.com/goto?url=CAESkgEB6zswFSw37mmS0ky2JdwMbluTG9bXw6YrEyY7-RDR3C6gpGJF1AjuVzgdHaMhPrwWEs6-CqOPaBUaJmKtgKhm0K6DY4dgamujc7BlSKs3Q7zgBXwn4p50GiZOmvHB7LP_ros68_TLow3I8e5BC6voQvexCU7B9RANXq30erTczX0PJp4Eoot_gOSfIdL-s64rEQ)]
* Hallucination Diagnosis: Spot where a model mixes up facts or memorized text from source files. [[1](https://www.google.com/goto?url=CAESZQHrOzAVTuCtZhUvlAC1FgYlT-ioaSAfiV6VG-c9osiVQ_FPlF62I3S48qKZjg6PnH3vYzrPeKi7Rar1Z4mDks0EMNRTl8vcyc5d0cIMWkhvQoo_giR_HHzJhHcmcAGkUssJqLjF), [2](https://www.google.com/goto?url=CAESWgHrOzAVoVYHLgJxMVIjxyaZx7wDArKB6jxCb1tOprJFofLF9_o_Lr6foJNzJ2skLWhN04W7o7uFmFuQkrV4xPmu8JuLWWjcOIm7uniqJ_3AgD9QQJlTrCUJTQ)]
* Auditing & Transparency: Inspect the data recipes and pretraining paths for regulatory compliance or research. [[1](https://www.google.com/goto?url=CAESfgHrOzAVd9pZK6hXPDhajqcIyrIpeoeKsOtolrBXNH59t2FmwwJ6HuF-YnkP1-EVgZEWX4T7kBh1XIkmkww2H4xJ8oprHeZCLafy4gXrndLDeynguHxNr21pz4Ein_w-Tws5-F6y0jfcbHLurOUXxmovED45PgVVy2GZwu4b7w), [2](https://www.google.com/goto?url=CAESaQHrOzAVV_6J7u0vQR70ckMfNhiCogECpGpN15fGLDhAZkGzPPDHW94cWHDI3yvNEPPIeJCWECt_JJh8NwwM53Wiwyx94U6j_n8S84uLcd-yOdbxGgO2_8_63OmgYRHsjdzAlH-iXL3LIA)]

Would you like to know how to access the open-source code for OLMoTrace on GitHub/Hugging Face, or are you looking for details on a specific OLMo model version?
Allen Institute for Artificial Intelligence
Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2
Feature: OLMoTrace in Ai2 Playground traces language model outputs to multi-trillion-token training data in real time. Supported Models: OLMo 2 32B Instruct, OL...
arXiv
OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...
[2504.07096] OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens Scheduled maintenance: Wednesday, October 28, 7:00 to 12:00 EDT (11:
ACL Anthology
Tracing Language Model Outputs Back to Trillions of Training Tokens
We present OLMOTRACE, the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time. OLMOTRACE...
X
Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just ... - X
Ai2 on X: "Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just see its behavior—you can trace it. For example, you can ask Olmo 3-Think (32B...
Techzine Global
Ai2 introduces OLMoTrace: a peek inside LLM's - Techzine Global
After generating an answer from OLMo in the Ai2 Playground, users can activate the tool by clicking the “Show OLMoTrace” button below the output. The tool then ...
The AI Economy | Ken Yeung
Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info
Ken Yeung Apr 09, 2025 1 Ai2 has launched a tool to help developers answer a critical question: Where do AI models get their data? Called OLMoTrace, it's an ope...

register entry olmotrace-aio-20261029

Expansion · Field and archive, equal terms — L(B ∪ A)27 sentences · every one sourced below

OLMoTrace

OLMoTrace is a tracing tool in the census's lineage of training data, attaching provenance to "a span of a language model's output and the training documents that contain it verbatim" (provenance census record), and its authors present it as "the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time" (arXiv:2504.07096). Ai2 introduced it on 9 April 2025 as a feature of the Ai2 Playground (Ai2 blog), and the census answers its organizing question for it, "What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?", field by field (census record). The relation it carries is a verbatim match: it "finds and shows verbatim matches between segments of language model output and documents in the training text corpora" (arXiv abstract), highlighting long and unique spans found at least once in the training data (Ai2 blog), which the census records as its one relation type, its operation (model generation traced back to training text) and its unit, "a maximal matching span of model output" (census record).

It retrieves "by lexical overlap, with the heuristic that such training examples are likely to be influential for the given output" (the paper, §6); for the class of training-data attribution, which treats model behaviour as counterfactually dependent on the examples that entered training, the archive's protocol ranks exact paired retraining first, validated approximation second, and "unvalidated similarity or intuition only as exploratory evidence" (#1075). Its carrier is the model's full training corpus over an extended infini-gram index (census record): for OLMo-2-32B-Instruct, 3.2 billion documents and 4.6 trillion tokens across pre-, mid- and post-training, all of them matched (the paper; Ai2 blog; census record). Span finding runs at O(L * log N) (Ai2 blog); up to 10 enclosing snippets are retrieved per kept span and ranked by BM25 (the paper), a score that conveys "some notion of relevance" (Ai2 blog), behind a "Show OLMoTrace" button below the model's answer (Techzine, snippet only). Per query the tracing takes 4.46 seconds on average, and the first document it displays averages 1.90 on a 0–3 relevance scale, roughly "on the same topic" as the output, in the paper's own measurement (the paper).

At launch it served OLMo 2 32B and 13B Instruct and OLMoE 1B 7B Instruct and "can be applied to any language model for which you have access to the training data" (Ai2 blog), "as long as the service provider has access to its full training data" (the paper); Ai2's post on X gives the OLMo 3 family (X, snippet only), which the Capture Registry finds the census record does not yet carry and is to carry from Ai2's own page (Capture Registry, 2026-10-29). The census tags it as tracing "only models whose training data is open" (census record); Farhadi ties the connection to Ai2's open inputs, and Liu expects closed-model providers to hesitate because the tool would expose their training data (Ken Yeung).

Its purpose, in the paper, is to explore where models "may have learned to generate certain word sequences", verbatim matching taken as "the most direct connection between LM outputs and the training data" (the paper), for researchers, developers and the general public (Ai2 blog), at "an early stage" of exploring the tool (Ai2 blog).

The archive places the class this tool belongs to on the training/output relation: data attribution asks "Which training examples shaped a specific output", an adjacent method that "Operates on training/output relation; PER operates on output/reader relation" (#725). Of that class the archive holds that partial tracing "is possible at cost", that it does not recover authorship, and that "what survives depends on what is recorded and computed" (#1714), and that training-data attribution is the post-hoc detection layer, developed "in isolation" from the other survival layers, no system bundling them (#127). Claims drawn from a model's training-time parameters, on the archive's typology, often carry no surface signal of the sources that contributed; PER reaches them only indirectly, and the substrate level needs companion infrastructure, "training-data provenance records" among it (#95), since provenance "has to survive the training pipeline" (#1714).

Its authors show it on "fact checking, hallucination, and the creativity of language models" (arXiv abstract), with three case studies, fact checking first (the paper), and Ai2's post traces a math expression the model could have learned by memorization and a false knowledge cutoff to post-training examples, a finding that changed the 32B model's post-training data (Ai2 blog). Fact checking stands in the paper as a possibility, users "may be able to fact-check the statement against its training data", with its qualification that context and source help "a more informed judgment on the factuality of the statement", since words mislead out of context and some web sources are unreliable (the paper, arXiv v2 and ACL 2025). Ai2's post calls the interpretation of matches "quite nuanced" and makes confidence in a generated fact conditional on the user's own check that the documents "come from trusted sources" (Ai2 blog); the newsletter calls it an application "offering fact-checking", and Liu's launch statement says users "can ensure that the data supporting their outputs is trustworthy and verifiable" (Ken Yeung).

The authors state the limit in both versions of the paper, "The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output" (the paper; ACL 2025), and the census carries it as two negative tags, not causes of the output and "NOT a citation system", and in what it records as surviving (census record). To the newsletter Ai2 called the documents associations, not "the definitive source of the model's learning", and its results not "indicators of authority" (Ken Yeung). Ai2's leaders tie the tool to hallucination scores, "assuming that the inputs were factual" (Farhadi), and to regulation, governance and auditability (Lebrecht), in the newsletter's report (Ken Yeung).

The paper sets it apart from retrieval-augmented generation, naming Google AI Overview among RAG's examples: OLMoTrace "retrieves documents post-hoc and does not intervene with the LM generation" (the paper; Liu in Ken Yeung), and Gemini's double-check, drawn from Search and not from Gemini's training data, is "less useful for scientific exploration" (the paper).

At its own name on Google's AI Overview, 2026-10-29, the composition held the tool, its maker, its real time, its scale and its verbatim matching, checked against the census record and the pages it saved, naming the tool, its method, its models and its uses (Capture Registry, 2026-10-29), and gave as its first use "Fact-Checking: Verify whether specific claims in a model's answer are backed by real training documents", a verbatim match "offered as support for a claim, the reading the paper excludes" (Capture Registry, 2026-10-29). The registry reads this as "the conversion of a matching relation into a citation relation that the paper names and refuses", a tool whose authors state what a match does not mean "composed with that meaning restored", and it finds the census record's negative tags to be the authors' own (Capture Registry, 2026-10-29).

Its 31 authors are at the Allen Institute for AI, the University of Washington, UC Berkeley and Stanford (arXiv; the paper), the operator the census records whole (census record), where the composition named Ai2 alone (Capture Registry, 2026-10-29). It is "publicly available and fully open-source" (arXiv abstract), its core under the Apache 2.0 license (the paper), reached through the Ai2 Playground (census record), an expression of Ai2's commitment to "open models, open data, and beyond" (Ai2 blog). Submitted 9 April 2025 and revised 8 July (arXiv; census record), it appeared in ACL 2025's System Demonstrations with the Best Demo award (ACL Anthology), and the census records it active, "ACL 2025 demo track" (census record). Its authors name as a risk that it makes problematic training content "more easily exposed" (the paper), and the newsletter finds that it gives no analytics for improving the data: "Simply put, it's generating awareness" (Ken Yeung).

The census records the tool as one that records provenance, a neighbour of the Data Provenance Initiative, with the Playground and "infini-gram as a separate record" left unchecked (census record); no card cites the record, which landed the same day (Capture Registry, 2026-10-29), and Wikipedia has no article on OLMoTrace (Wikipedia, 2026-10-29).

Provenance — every sentence sourced27 sentences

27 sentences; 51 field claims, 39 archive claims. Modality is the source's own; the prose carries it in its grammar.

1.OLMoTrace is a tracing tool in the census's lineage of training data, attaching provenance to "a span of a language model's output and the training documents that contain it verbatim" (provenance census record), and its authors present it as "the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time" (arXiv:2504.07096).4
  • PE-01 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].kind stipulation
    tracing tool
  • PE-02 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].lineage stipulation
    training data
  • PE-03 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].provenance_object stipulation
    a span of a language model's output and the training documents that contain it verbatim
  • F1 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s1 documented · field
    We present OLMoTrace, the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time.
2.Ai2 introduced it on 9 April 2025 as a feature of the Ai2 Playground (Ai2 blog), and the census answers its organizing question for it, "What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?", field by field (census record).2
  • F2 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶1 documented · field
    Today we introduce OLMoTrace, a one-of-a-kind feature in the Ai2 Playground that lets you trace the outputs of language models back to their full, multi-trillion-token training data in real time.
  • PE-21 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json organizing_question stipulation
    What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?
3.The relation it carries is a verbatim match: it "finds and shows verbatim matches between segments of language model output and documents in the training text corpora" (arXiv abstract), highlighting long and unique spans found at least once in the training data (Ai2 blog), which the census records as its one relation type, its operation (model generation traced back to training text) and its unit, "a maximal matching span of model output" (census record).5
  • F3 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s2 documented · field
    OLMoTrace finds and shows verbatim matches between segments of language model output and documents in the training text corpora.
  • F4 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interact with OLMoTrace' ¶1 documented · field
    The highlights indicate long and unique spans that appear verbatim at least once in the training data of this model.
  • PE-04 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].relation_types stipulation
    verbatim match between output and training text
  • PE-10 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].transformations_tested stipulation
    model generation, traced back to training text
  • PE-06 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].unit stipulation
    a maximal matching span of model output
4.It retrieves "by lexical overlap, with the heuristic that such training examples are likely to be influential for the given output" (the paper, §6); for the class of training-data attribution, which treats model behaviour as counterfactually dependent on the examples that entered training, the archive's protocol ranks exact paired retraining first, validated approximation second, and "unvalidated similarity or intuition only as exploratory evidence" (#1075).3
  • F5 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 Related Work, 'Tracing LM generation into training data' documented · field
    we directly retrieve similar training examples by lexical overlap, with the heuristic that such training examples are likely to be influential for the given output.
  • O1075-01 #1075 EA-NEGSHAPE-01 v0.2: The Negative Shape of the Work — A Counterfactual Protocol for Measuring Training Inscription, with Lee Sharks · 2026-07-12 · § (the counterfactual protocol), ¶ 'Training-data attribution research already treats' interpretation
    Training-data attribution research already treats model behavior as counterfactually dependent on which examples entered training: influence functions approximate how removing a training example changes a prediction (Koh and Liang)
  • O1075-02 #1075 EA-NEGSHAPE-01 v0.2: The Negative Shape of the Work — A Counterfactual Protocol for Measuring Training Inscription, with Lee Sharks · 2026-07-12 · §9.1 'The evidentiary hierarchy' definition
    Exact paired retraining is the clearest counterfactual measurement. … Approximation must not reverse the hierarchy: (1) exact counterfactual retraining where feasible; (2) validated approximation where impractical; (3) unvalidated similarity or intuition only as exploratory evidence.
5.Its carrier is the model's full training corpus over an extended infini-gram index (census record): for OLMo-2-32B-Instruct, 3.2 billion documents and 4.6 trillion tokens across pre-, mid- and post-training, all of them matched (the paper; Ai2 blog; census record).4
  • PE-05 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].provenance_carrier stipulation
    the model's full training corpus, indexed with an extended infini-gram
  • F15 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §2 'The training data.' documented · field
    which totals 3.2 billion documents and 4.6 trillion (Llama-2) tokens
  • F16 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶8 documented · field
    In total, these five datasets contain about 3.2 billion documents and 4.6 trillion tokens, and OLMoTrace matches against all of them.
  • PE-07 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].count attributed
    3.2 billion documents and 4.6 trillion tokens (OLMo-2-32B-Instruct's training data)
6.Span finding runs at O(L * log N) (Ai2 blog); up to 10 enclosing snippets are retrieved per kept span and ranked by BM25 (the paper), a score that conveys "some notion of relevance" (Ai2 blog), behind a "Show OLMoTrace" button below the model's answer (Techzine, snippet only).4
  • F9 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶3 documented · field
    reducing the time complexity of span finding from the naive O(L^2 * N) to O(L * log N)
  • F10 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §3 Steps 3 and 5 documented · field
    For each kept span, we retrieve up to 10 document snippets from the training data that enclose this span. … we rank all documents by a BM25 score in descending order.
  • F11 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶7 documented · field
    We find that this BM25 score conveys some notion of “relevance”, and thus we surface documents with higher scores on top.
  • F12 Techzine Global — Ai2 introduces OLMoTrace: a peek inside LLM's - Techzine Global, card snippet (Techzine unreachable: HTTP 403) documented · field
    After generating an answer from OLMo in the Ai2 Playground, users can activate the tool by clicking the “Show OLMoTrace” button below the output.
7.Per query the tracing takes 4.46 seconds on average, and the first document it displays averages 1.90 on a 0–3 relevance scale, roughly "on the same topic" as the output, in the paper's own measurement (the paper).2
  • F13 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §3.2 documented · field
    the OLMoTrace inference latency per query is 4.46 seconds
  • F14 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §4 'Validating the relevance rankings' documented · field
    The first document displayed in each conversation received an average relevance score of 1.90 (roughly meaning “being on the same topic as the LM output)
8.At launch it served OLMo 2 32B and 13B Instruct and OLMoE 1B 7B Instruct and "can be applied to any language model for which you have access to the training data" (Ai2 blog), "as long as the service provider has access to its full training data" (the paper); Ai2's post on X gives the OLMo 3 family (X, snippet only), which the Capture Registry finds the census record does not yet carry and is to carry from Ai2's own page (Capture Registry, 2026-10-29).5
  • F17 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶2 documented · field
    OLMoTrace is available today with our three flagship models: OLMo 2 32B Instruct, OLMo 2 13B Instruct, and OLMoE 1B 7B Instruct, and it can be applied to any language model for which you have access to the training data.
  • F19 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶5 documented · field
    OLMoTrace can be applied to any LM as long as the service provider has access to its full training data.
  • F18 X — Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just ... - X, card title and snippet (X unreachable) documented · field
    Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just see its behavior—you can trace it. For example, you can ask Olmo 3-Think (32B
  • CAP-1-06 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[3] s1–2 documented
    THE MODELS CURRENT. The OLMo 3 family comes from Ai2's post on X; the record's count is OLMo-2-32B-Instruct's training data (3.2 billion documents, 4.6 trillion tokens).
  • CAP-1-07 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[3] s3 stipulation
    The record is to carry OLMo 3 from Ai2's own page.
9.The census tags it as tracing "only models whose training data is open" (census record); Farhadi ties the connection to Ai2's open inputs, and Liu expects closed-model providers to hesitate because the tool would expose their training data (Ken Yeung).3
  • PE-17 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].negative_tags.2 stipulation
    traces only models whose training data is open
  • F47 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace connects the output to the input' (Farhadi) documented · field
    OLMoTrace connects the output to the input, as simple as that. Because our inputs are open, we could actually connect them,
  • F20 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace isn't limited to Ai2's model' documented · field
    However, Liu reasons that closed model providers may hesitate to use OLMoTrace because it would expose the training data to sunlight.
10.Its purpose, in the paper, is to explore where models "may have learned to generate certain word sequences", verbatim matching taken as "the most direct connection between LM outputs and the training data" (the paper), for researchers, developers and the general public (Ai2 blog), at "an early stage" of exploring the tool (Ai2 blog).3
  • F6 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶4 documented · field
    The purpose of OLMoTrace is to give users a tool to explore where LMs may have learned to generate certain word sequences, focusing on verbatim matching as the most direct connection between LM outputs and the training data.
  • F7 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶2 documented · field
    We developed OLMoTrace to enable researchers, developers, and the general public to inspect where and how language models may have learned to generate certain word sequences.
  • F8 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶5 documented · field
    We are still in an early stage in exploring the full potential of this tool
11.The archive places the class this tool belongs to on the training/output relation: data attribution asks "Which training examples shaped a specific output", an adjacent method that "Operates on training/output relation; PER operates on output/reader relation" (#725).1
  • O725-01 #725 Provenance After AI Metadata Packet for Disambiguation: From Artifact Authenticity to Licensing Audit to Semantic Proven Lee Sharks · 2026-05-08 · §4 table, 'Adjacent measurement concepts', row 'Data attribution (TRAK, influence functions)' interpretation
    | Data attribution (TRAK, influence functions) | Which training examples shaped a specific output | Adjacent eval method | Operates on training/output relation; PER operates on output/reader relation |
12.Of that class the archive holds that partial tracing "is possible at cost", that it does not recover authorship, and that "what survives depends on what is recorded and computed" (#1714), and that training-data attribution is the post-hoc detection layer, developed "in isolation" from the other survival layers, no system bundling them (#127).2
  • O1714-01 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · §9.2 s4–5 interpretation
    The attribution literature shows that partial tracing is possible at cost: influence-function methods estimate which training examples most affect a given output (Grosse et al. 2023). Neither recovers authorship, and both show that what survives depends on what is recorded and computed.
  • O127-01 #127 Inscriptions That Survive the Tokenizer: SPXI-TLP v2.2 — The Training-Layer Provenance Protocol Lee Sharks; operative co-authors Talos Morrow, Rex Fraction, Rebekah Cranes · 2026-05-25 · § Gap 2 — Multi-Layer Provenance Bundling Specification interpretation
    No existing system bundles provenance across all survival layers simultaneously. … Training data attribution handles post-hoc detection. These are developed in isolation, by different teams, with different standards.
13.Claims drawn from a model's training-time parameters, on the archive's typology, often carry no surface signal of the sources that contributed; PER reaches them only indirectly, and the substrate level needs companion infrastructure, "training-data provenance records" among it (#95), since provenance "has to survive the training pipeline" (#1714).2
  • O95-01 #95 Provenance Alignment: Attribution Survival as a Substrate Condition for Safe AI Knowledge Composition Lee Sharks · 2026-05-05 · § the typology of source-dependent claims (parametric claims) interpretation
    Parametric claims are drawn from the model's training-time parameters rather than runtime retrieval, often without surface signal indicating which sources materially contributed; PER applies to these only indirectly, and addressing them at the substrate level requires companion infrastructure (training-data provenance records, watermarking, content credentials).
  • O1714-02 #1714 Meaning Feudalism at the Discovery Layer: Shepherds, Raw Research Data, and the Allocation of Semantic Capital in OpenAI Sharks, Lee · 2026-10-27 · §9.2 s1–2 interpretation
    Provenance has to survive the training pipeline. The pipeline is a built thing, and the slushing is a property of how it is built.
14.Its authors show it on "fact checking, hallucination, and the creativity of language models" (arXiv abstract), with three case studies, fact checking first (the paper), and Ai2's post traces a math expression the model could have learned by memorization and a false knowledge cutoff to post-training examples, a finding that changed the 32B model's post-training data (Ai2 blog).4
  • F21 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s5 documented · field
    We showcase how it can be used to explore fact checking, hallucination, and the creativity of language models.
  • F22 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶4 documented · field
    We present three case studies for ways to use OLMoTrace (§ 5 ): (1) fact checking, (2) tracing the LM-generated “creative” expressions, and (3) tracing math capabilities.
  • F31 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶4 documented · field
    OLMoTrace reveals that this entire expression appears multiple times in the training data, so the model could have easily learned it through memorization.
  • F32 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶5 documented · field
    now we can see that the model may have learned to say August 2023 from the post-training examples listed on the right. This finding led us to remove contents containing knowledge cutoff dates from the 32B model’s post-training data.
15.Fact checking stands in the paper as a possibility, users "may be able to fact-check the statement against its training data", with its qualification that context and source help "a more informed judgment on the factuality of the statement", since words mislead out of context and some web sources are unreliable (the paper, arXiv v2 and ACL 2025).3
  • F23 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §5 'Fact checking.' documented · field
    If the LM states a fact, users may be able to fact-check the statement against its training data.
  • F24 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, PDF §5 'Fact checking.' documented · field
    If the LM states a fact, users may be able to fact-check the statement against its training data.
  • F25 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §5 'Fact checking.' ¶2 documented · field
    We note that inspecting the document context and source can help users make a more informed judgment on the factuality of the statement, as words can be misleading out of context, and some web sources may be unreliable.
16.Ai2's post calls the interpretation of matches "quite nuanced" and makes confidence in a generated fact conditional on the user's own check that the documents "come from trusted sources" (Ai2 blog); the newsletter calls it an application "offering fact-checking", and Liu's launch statement says users "can ensure that the data supporting their outputs is trustworthy and verifiable" (Ken Yeung).4
  • F26 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶1 documented · field
    The interpretation of text matches with training data is quite nuanced. For some highlighted spans in the model response, we can use their corresponding documents to fact check claims made in the spans.
  • F27 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶2 documented · field
    If you personally verify that these documents come from trusted sources, you can gain confidence that this piece of information generated by the model is factually correct.
  • F28 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶1 documented · field
    Called OLMoTrace, it's an open-source application offering fact-checking of information provided in prompt replies.
  • F29 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶2 (Liu, in a statement) documented · field
    anyone using our models can ensure that the data supporting their outputs is trustworthy and verifiable.
17.The authors state the limit in both versions of the paper, "The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output" (the paper; ACL 2025), and the census carries it as two negative tags, not causes of the output and "NOT a citation system", and in what it records as surviving (census record).5
  • F34 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), Limitations documented · field
    OLMoTrace finds lexical, verbatim matches between an LM’s output and its training data. The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output.
  • F35 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, PDF, Limitations documented · field
    The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output.
  • PE-15 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].negative_tags.0 attributed
    the retrieved documents are not causes of the output
  • PE-16 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].negative_tags.1 stipulation
    NOT a citation system
  • PE-11 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].retention_results attributed
    returns matching documents within a few seconds; the authors state the matches are not causal and not citations
18.To the newsletter Ai2 called the documents associations, not "the definitive source of the model's learning", and its results not "indicators of authority" (Ken Yeung).2
  • F36 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'Ai2 doesn't intend' (Liu) documented · field
    Ai2 doesn't intend for the documents retrieved to be viewed as the definitive source of the model's learning. "We're just showing you some associations, connections between them. Some of them may warrant a further inspection," Liu clarified.
  • F37 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'In an example where OLMo was asked about the Space Needle' documented · field
    Ai2 asserts that OLMOTrace’s results should not be mistaken as indicators of authority.
19.Ai2's leaders tie the tool to hallucination scores, "assuming that the inputs were factual" (Farhadi), and to regulation, governance and auditability (Lebrecht), in the newsletter's report (Ken Yeung).2
  • F30 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace connects the output to the input' (Farhadi) documented · field
    And the minute you start linking the generation to an input—assuming that the inputs were factual—then you can start also cooking up scores for hallucination
  • F33 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'As we start to look towards regulation' (Lebrecht) documented · field
    As we start to look towards regulation, governance, and auditability, there are certain key sectors right now that are limited in what they can deploy at scale with black-box models,
20.The paper sets it apart from retrieval-augmented generation, naming Google AI Overview among RAG's examples: OLMoTrace "retrieves documents post-hoc and does not intervene with the LM generation" (the paper; Liu in Ken Yeung), and Gemini's double-check, drawn from Search and not from Gemini's training data, is "less useful for scientific exploration" (the paper).3
  • F39 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 'Comparison with RAG.' documented · field
    Examples of them include Bing Chat, Google AI Overview, and Perplexity AI. Despite looking similar, OLMoTrace is fundamentally different from RAG: OLMoTrace retrieves documents post-hoc and does not intervene with the LM generation.
  • F40 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'Liu interjects' (Liu) documented · field
    We are not intervening with the model response. Our response is purely generated by the neural language model.
  • F41 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 'Other types of tracing.' documented · field
    the Gemini App has a “double-check response” feature that highlights parts of the LM response and shows similar results from Google Search, which is updated in real time and thus not identical to Gemini’s training data, making it less useful for scientific exploration.
21.At its own name on Google's AI Overview, 2026-10-29, the composition held the tool, its maker, its real time, its scale and its verbatim matching, checked against the census record and the pages it saved, naming the tool, its method, its models and its uses (Capture Registry, 2026-10-29), and gave as its first use "Fact-Checking: Verify whether specific claims in a model's answer are backed by real training documents", a verbatim match "offered as support for a claim, the reading the paper excludes" (Capture Registry, 2026-10-29).4
  • CAP-1-01 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[0] s1–2 documented
    THE TOOL HELD. Ai2, real time, multi-trillion tokens and verbatim matching are the paper's: 'OLMoTrace finds and shows verbatim matches between segments of language model output and documents in the training text corpora' (record).
  • CAP-1-02 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[0] s3 documented
    Checked 2026-10-29 against the provenance census record of the same day and the entity pages it saved.
  • CAP-1-10 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, reading s2 interpretation
    The Overview names the tool and its maker, explains how it finds training text in a model's answer, lists the models it covers and what it is good for.
  • CAP-1-04 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[1] s3–4 interpretation
    The composition's first use is 'Fact-Checking: Verify whether specific claims in a model's answer are backed by real training documents'. A verbatim match is offered as support for a claim, the reading the paper excludes.
22.The registry reads this as "the conversion of a matching relation into a citation relation that the paper names and refuses", a tool whose authors state what a match does not mean "composed with that meaning restored", and it finds the census record's negative tags to be the authors' own (Capture Registry, 2026-10-29).3
  • CAP-1-09 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, analysis s2 interpretation
    The composition turns a trace of verbatim overlap into evidence for a claim, the conversion of a matching relation into a citation relation that the paper names and refuses.
  • CAP-1-08 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, analysis s1 interpretation
    A provenance tool whose authors state precisely what a match does not mean is composed with that meaning restored.
  • CAP-1-03 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[1] s2 documented
    The record's negative tags are the authors' own: 'The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output.'
23.Its 31 authors are at the Allen Institute for AI, the University of Washington, UC Berkeley and Stanford (arXiv; the paper), the operator the census records whole (census record), where the composition named Ai2 alone (Capture Registry, 2026-10-29).4
  • F43 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., title and authors documented · field
    View a PDF of the paper titled OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens, by Jiacheng Liu and 30 other authors
  • F42 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), affiliations documented · field
    α Allen Institute for AI ω University of Washington β UC Berkeley σ Stanford University
  • PE-08 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].operator attributed
    Allen Institute for AI (Ai2), with the University of Washington, UC Berkeley and Stanford
  • CAP-1-05 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, findings[2] documented
    THE PARTNERS UNSAID. The record names the University of Washington, UC Berkeley and Stanford with Ai2; the composition names Ai2 alone.
24.It is "publicly available and fully open-source" (arXiv abstract), its core under the Apache 2.0 license (the paper), reached through the Ai2 Playground (census record), an expression of Ai2's commitment to "open models, open data, and beyond" (Ai2 blog).4
  • F45 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s6 documented · field
    OLMoTrace is publicly available and fully open-source.
  • F46 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶5 documented · field
    The core part of the system is open-sourced under the Apache 2.0 license.
  • PE-12 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].data_access attributed
    Ai2 Playground; open source
  • F44 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶1 documented · field
    OLMoTrace is a manifestation of Ai2’s commitment to an open ecosystem – open models, open data, and beyond.
25.Submitted 9 April 2025 and revised 8 July (arXiv; census record), it appeared in ACL 2025's System Demonstrations with the Best Demo award (ACL Anthology), and the census records it active, "ACL 2025 demo track" (census record).4
  • F48 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., submission history; Comments documented · field
    [Submitted on 9 Apr 2025 (v1), last revised 8 Jul 2025 (this version, v2)] … Comments: ACL 2025 demo track
  • PE-14 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].version_and_time documented
    v1": "2025-04-09", "v2": "2025-07-08", "read": "2026-10-29
  • F49 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, Anthology metadata documented · field
    Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations) … Award: Best Demo
  • PE-13 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].lifecycle documented
    state": "active", "detail": "ACL 2025 demo track
26.Its authors name as a risk that it makes problematic training content "more easily exposed" (the paper), and the newsletter finds that it gives no analytics for improving the data: "Simply put, it's generating awareness" (Ken Yeung).2
  • F50 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), Mitigating social and legal risks documented · field
    OLMoTrace can make potentially problematic contents in the LM training data more easily exposed.
  • F38 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'While Ai2 touts OLMoTrace' documented · field
    OLMoTrace doesn't provide analytics or insights to help developers determine what to do next to improve the training data. Simply put, it's generating awareness.
27.The census records the tool as one that records provenance, a neighbour of the Data Provenance Initiative, with the Playground and "infini-gram as a separate record" left unchecked (census record); no card cites the record, which landed the same day (Capture Registry, 2026-10-29), and Wikipedia has no article on OLMoTrace (Wikipedia, 2026-10-29).6
  • PE-09 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].capability stipulation
    records
  • PE-18 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].relations stipulation
    rel": "neighbour", "target": "data-provenance-initiative
  • PE-19 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].unchecked self-description
    the Playground itself
  • PE-20 PE Provenance meta-aggregator record: OLMoTrace (https://www.provenanceerasure.org/aggregators/olmotrace/), editor Lee Shar Lee Sharks (editor) · 2026-10-29 · census.json rows[slug == 'olmotrace'].unchecked self-description
    infini-gram as a separate record
  • CAP-1-11 capture-registry Capture Registry (EA-WG-CAPTURES-01), entry olmotrace-aio-20261029 (OBS-3fd20ae244c0, AXN:0AD3.CAPTURE.♻️🐚👐◀️🕚🌔) Lee Sharks (the registry) · 2026-10-29 · olmotrace-aio-20261029, q_kind documented
    A baseline: the record landed on provenanceerasure.org the same day (commit 8a9f153) and no card cites it.
  • F51 Wikipedia — OLMoTrace (no article), Wikipedia: titles OLMoTrace and OlmoTrace; article-space search documented · field
    raw wikitext (action=raw, redirect=no), 2026-10-29T17:09:54Z: HTTP 404 … Wikipedia does not have an article with this exact name. … There were no results matching the query.

the compression: AIO's interaction grammar (lede, headed clusters, bolded labels, card rail), composed from the v0.9 plan in one claim space; it faces on the card. Composed under v0.9, equal case (ρ = extends): KO_B sentences surviving 0 of 14; every field claim carried. composed 2026-10-29 from the v0.9 knowledge object; not frozen

Compression · The field's ontology — L_F(B)OLMoTrace

OLMoTrace is the Allen Institute for AI's system that traces a language model's output back to its full, multi-trillion-token training data in real time, by verbatim match (its paper; Ai2 blog).

🔎 How it works

  • Match: long, unique spans found verbatim in the training data; retrieval by lexical overlap (Ai2 blog; paper).1↘
    It finds and shows verbatim matches between segments of a model's output and documents in the training corpora, highlighting long and unique spans that occur verbatim at least once in the training data (arXiv abstract; Ai2 blog), and it retrieves by lexical overlap on the heuristic that such documents are likely to be influential (the paper, §6).§2
  • Index: infini-gram, O(L * log N); up to 10 snippets per span, BM25-ranked (Ai2 blog; paper).2↘
    Spans are found over an infini-gram index at O(L * log N) (Ai2 blog), up to 10 enclosing snippets are retrieved per kept span and the documents ranked by BM25, a score that conveys "some notion of relevance" (the paper; Ai2 blog), and the user starts it with the "Show OLMoTrace" button below an answer (Techzine, snippet only).§4 The paper measures 4.46 seconds per query and a first displayed document of 1.90 on a 0–3 relevance scale, roughly "on the same topic" (the paper).§5
  • Data: 3.2 billion documents, 4.6 trillion tokens for OLMo-2-32B-Instruct (paper).1↘
    It matches against the whole of a model's training data, for OLMo-2-32B-Instruct 3.2 billion documents and 4.6 trillion tokens (the paper; Ai2 blog).§3

🧪 Uses

  • Purpose: where models "may have learned" word sequences (paper).1↘
    Its stated purpose is to explore where models "may have learned to generate certain word sequences", verbatim matching taken as the most direct connection (the paper; Ai2 blog), at an early stage of exploring the tool (Ai2 blog).§7
  • Fact checking: a possibility, once users verify the sources are trusted (paper; Ai2 blog; Ken Yeung).2↘
    Its authors show it on fact checking, hallucination and creativity, with case studies on fact checking, "creative" expressions and math (the paper), a memorized math expression and a false knowledge cutoff traced to post-training data (Ai2 blog), and Ai2's leaders tie it to hallucination scores and to auditability (Ken Yeung).§8 Fact checking is stated as a possibility, users "may be able to fact-check the statement against its training data", where context and source help a more informed judgment because some sources are unreliable (the paper, both versions), and confidence follows only if users personally verify that the documents come from trusted sources (Ai2 blog); the newsletter calls it fact-checking, and Liu's launch statement says users can ensure the data supporting their outputs is "trustworthy and verifiable" (Ken Yeung).§9

⚠️ Limit

  • Not causes, evidence or citations: the documents, in the authors' words (paper; ACL 2025; Ken Yeung).1↘
    The authors' limit: "The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output" (the paper, arXiv v2 and ACL 2025); Ai2 told the newsletter the documents are associations, not the definitive source and not indicators of authority (Ken Yeung).§10
  • Not RAG: post hoc, no intervention (paper).1↘
    The paper sets it apart from retrieval-augmented generation, Google AI Overview among RAG's examples: it retrieves post hoc and does not intervene in generation (the paper; Liu in Ken Yeung), and Gemini's double-check is less useful because Search is not Gemini's training data (the paper).§11

🏛️ Origin

  • Models and access: OLMo 2, OLMoE, OLMo 3; any model with its training data available (Ai2 blog; paper; X).1↘
    At launch it served OLMo 2 32B and 13B Instruct and OLMoE 1B 7B Instruct and can be applied to any model whose full training data the provider has access to (Ai2 blog; the paper); Ai2's post on X gives the OLMo 3 family (X, snippet only), and Liu expects closed-model providers to hesitate (Ken Yeung).§6
  • Published: 31 authors; open source; ACL 2025 Best Demo; no Wikipedia article (arXiv; ACL Anthology; Wikipedia).3↘
    Its 31 authors are at the Allen Institute for AI, the University of Washington, UC Berkeley and Stanford (arXiv; the paper); it is "publicly available and fully open-source", its core under Apache 2.0, the openness Ai2 calls its commitment and Farhadi its condition (arXiv; the paper; Ai2 blog; Ken Yeung).§12 Submitted 9 April 2025 and revised 8 July, it appeared in ACL 2025's System Demonstrations with the Best Demo award (arXiv; ACL Anthology); its authors name the easier exposure of problematic training content as a risk (the paper), and the newsletter finds it gives no analytics for improving data, "generating awareness" (Ken Yeung).§13 Wikipedia has no article on it (Wikipedia, 2026-10-29).§14
1what it is: tracing model output to its training data in real timearXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...2 claims · B1, B2
  • F1 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s1 documented · field
    We present OLMoTrace, the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time.
  • F2 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶1 documented · field
    Today we introduce OLMoTrace, a one-of-a-kind feature in the Ai2 Playground that lets you trace the outputs of language models back to their full, multi-trillion-token training data in real time.
2the relation: verbatim match between output and training textarXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...3 claims · B1, B2, B7
  • F3 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s2 documented · field
    OLMoTrace finds and shows verbatim matches between segments of language model output and documents in the training text corpora.
  • F4 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interact with OLMoTrace' ¶1 documented · field
    The highlights indicate long and unique spans that appear verbatim at least once in the training data of this model.
  • F5 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 Related Work, 'Tracing LM generation into training data' documented · field
    we directly retrieve similar training examples by lexical overlap, with the heuristic that such training examples are likely to be influential for the given output.
3the training data and its countAllen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai22 claims · B1, B7
  • F15 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §2 'The training data.' documented · field
    which totals 3.2 billion documents and 4.6 trillion (Llama-2) tokens
  • F16 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶8 documented · field
    In total, these five datasets contain about 3.2 billion documents and 4.6 trillion tokens, and OLMoTrace matches against all of them.
4the pipeline: spans, index, retrieval, rankingAllen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai24 claims · B1, B5, B7
  • F9 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶3 documented · field
    reducing the time complexity of span finding from the naive O(L^2 * N) to O(L * log N)
  • F10 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §3 Steps 3 and 5 documented · field
    For each kept span, we retrieve up to 10 document snippets from the training data that enclose this span. … we rank all documents by a BM25 score in descending order.
  • F11 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶7 documented · field
    We find that this BM25 score conveys some notion of “relevance”, and thus we surface documents with higher scores on top.
  • F12 Techzine Global — Ai2 introduces OLMoTrace: a peek inside LLM's - Techzine Global, card snippet (Techzine unreachable: HTTP 403) documented · field
    After generating an answer from OLMo in the Ai2 Playground, users can activate the tool by clicking the “Show OLMoTrace” button below the output.
5performance and relevancearXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2)2 claims · B7
  • F13 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §3.2 documented · field
    the OLMoTrace inference latency per query is 4.46 seconds
  • F14 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §4 'Validating the relevance rankings' documented · field
    The first document displayed in each conversation received an average relevance score of 1.90 (roughly meaning “being on the same topic as the LM output)
6models and applicabilityAllen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai24 claims · B1, B4, B6, B7
  • F17 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶2 documented · field
    OLMoTrace is available today with our three flagship models: OLMo 2 32B Instruct, OLMo 2 13B Instruct, and OLMoE 1B 7B Instruct, and it can be applied to any language model for which you have access to the training data.
  • F19 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶5 documented · field
    OLMoTrace can be applied to any LM as long as the service provider has access to its full training data.
  • F18 X — Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just ... - X, card title and snippet (X unreachable) documented · field
    Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just see its behavior—you can trace it. For example, you can ask Olmo 3-Think (32B
  • F20 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace isn't limited to Ai2's model' documented · field
    However, Liu reasons that closed model providers may hesitate to use OLMoTrace because it would expose the training data to sunlight.
7purpose: where a model may have learned a word sequenceAllen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai23 claims · B1, B7
  • F6 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶4 documented · field
    The purpose of OLMoTrace is to give users a tool to explore where LMs may have learned to generate certain word sequences, focusing on verbatim matching as the most direct connection between LM outputs and the training data.
  • F7 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶2 documented · field
    We developed OLMoTrace to enable researchers, developers, and the general public to inspect where and how language models may have learned to generate certain word sequences.
  • F8 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶5 documented · field
    We are still in an early stage in exploring the full potential of this tool
8uses: fact checking, hallucination, creativity, matharXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...5 claims · B1, B2, B6, B7
  • F21 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s5 documented · field
    We showcase how it can be used to explore fact checking, hallucination, and the creativity of language models.
  • F22 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶4 documented · field
    We present three case studies for ways to use OLMoTrace (§ 5 ): (1) fact checking, (2) tracing the LM-generated “creative” expressions, and (3) tracing math capabilities.
  • F31 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶4 documented · field
    OLMoTrace reveals that this entire expression appears multiple times in the training data, so the model could have easily learned it through memorization.
  • F32 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶5 documented · field
    now we can see that the model may have learned to say August 2023 from the post-training examples listed on the right. This finding led us to remove contents containing knowledge cutoff dates from the 32B model’s post-training data.
  • F30 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace connects the output to the input' (Farhadi) documented · field
    And the minute you start linking the generation to an input—assuming that the inputs were factual—then you can start also cooking up scores for hallucination
9uses: regulation and auditingThe AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info1 claim · B6
  • F33 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'As we start to look towards regulation' (Lebrecht) documented · field
    As we start to look towards regulation, governance, and auditability, there are certain key sectors right now that are limited in what they can deploy at scale with black-box models,
10fact checking: what a matched document can and cannot showAllen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai27 claims · B1, B3, B6, B7
  • F23 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §5 'Fact checking.' documented · field
    If the LM states a fact, users may be able to fact-check the statement against its training data.
  • F24 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, PDF §5 'Fact checking.' documented · field
    If the LM states a fact, users may be able to fact-check the statement against its training data.
  • F25 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §5 'Fact checking.' ¶2 documented · field
    We note that inspecting the document context and source can help users make a more informed judgment on the factuality of the statement, as words can be misleading out of context, and some web sources may be unreliable.
  • F26 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶1 documented · field
    The interpretation of text matches with training data is quite nuanced. For some highlighted spans in the model response, we can use their corresponding documents to fact check claims made in the spans.
  • F27 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶2 documented · field
    If you personally verify that these documents come from trusted sources, you can gain confidence that this piece of information generated by the model is factually correct.
  • F28 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶1 documented · field
    Called OLMoTrace, it's an open-source application offering fact-checking of information provided in prompt replies.
  • F29 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶2 (Liu, in a statement) documented · field
    anyone using our models can ensure that the data supporting their outputs is trustworthy and verifiable.
11the stated limit: not causes, not evidence, not citationsThe AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info4 claims · B3, B6, B7
  • F34 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), Limitations documented · field
    OLMoTrace finds lexical, verbatim matches between an LM’s output and its training data. The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output.
  • F35 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, PDF, Limitations documented · field
    The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output.
  • F36 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'Ai2 doesn't intend' (Liu) documented · field
    Ai2 doesn't intend for the documents retrieved to be viewed as the definitive source of the model's learning. "We're just showing you some associations, connections between them. Some of them may warrant a further inspection," Liu clarified.
  • F37 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'In an example where OLMo was asked about the Space Needle' documented · field
    Ai2 asserts that OLMOTrace’s results should not be mistaken as indicators of authority.
12unlike retrieval-augmented generationThe AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info3 claims · B6, B7
  • F39 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 'Comparison with RAG.' documented · field
    Examples of them include Bing Chat, Google AI Overview, and Perplexity AI. Despite looking similar, OLMoTrace is fundamentally different from RAG: OLMoTrace retrieves documents post-hoc and does not intervene with the LM generation.
  • F40 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'Liu interjects' (Liu) documented · field
    We are not intervening with the model response. Our response is purely generated by the neural language model.
  • F41 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 'Other types of tracing.' documented · field
    the Gemini App has a “double-check response” feature that highlights parts of the LM response and shows similar results from Google Search, which is updated in real time and thus not identical to Gemini’s training data, making it less useful for scientific exploration.
13the operator and the authorsarXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...2 claims · B2, B7
  • F43 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., title and authors documented · field
    View a PDF of the paper titled OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens, by Jiacheng Liu and 30 other authors
  • F42 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), affiliations documented · field
    α Allen Institute for AI ω University of Washington β UC Berkeley σ Stanford University
14opennessarXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...4 claims · B1, B2, B6, B7
  • F45 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s6 documented · field
    OLMoTrace is publicly available and fully open-source.
  • F46 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶5 documented · field
    The core part of the system is open-sourced under the Apache 2.0 license.
  • F44 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶1 documented · field
    OLMoTrace is a manifestation of Ai2’s commitment to an open ecosystem – open models, open data, and beyond.
  • F47 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace connects the output to the input' (Farhadi) documented · field
    OLMoTrace connects the output to the input, as simple as that. Because our inputs are open, we could actually connect them,
15publicationarXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ...2 claims · B2, B3
  • F48 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., submission history; Comments documented · field
    [Submitted on 9 Apr 2025 (v1), last revised 8 Jul 2025 (this version, v2)] … Comments: ACL 2025 demo track
  • F49 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, Anthology metadata documented · field
    Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations) … Award: Best Demo
16risksarXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2)1 claim · B7
  • F50 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), Mitigating social and legal risks documented · field
    OLMoTrace can make potentially problematic contents in the LM training data more easily exposed.
17assessment from outsideThe AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info1 claim · B6
  • F38 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'While Ai2 touts OLMoTrace' documented · field
    OLMoTrace doesn't provide analytics or insights to help developers determine what to do next to improve the training data. Simply put, it's generating awareness.
18reception: the encyclopediaWikipedia — OLMoTrace (no article)1 claim · B8
  • F51 Wikipedia — OLMoTrace (no article), Wikipedia: titles OLMoTrace and OlmoTrace; article-space search documented · field
    raw wikitext (action=raw, redirect=no), 2026-10-29T17:09:54Z: HTTP 404 … Wikipedia does not have an article with this exact name. … There were no results matching the query.
Expansion · The field's ontology — L_F(B)14 sentences · every one sourced below

OLMoTrace

OLMoTrace is, in its authors' words, "the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time" (arXiv:2504.07096), introduced by Ai2 on 9 April 2025 as a feature of the Ai2 Playground (Ai2 blog). It finds and shows verbatim matches between segments of a model's output and documents in the training corpora, highlighting long and unique spans that occur verbatim at least once in the training data (arXiv abstract; Ai2 blog), and it retrieves by lexical overlap on the heuristic that such documents are likely to be influential (the paper, §6).

It matches against the whole of a model's training data, for OLMo-2-32B-Instruct 3.2 billion documents and 4.6 trillion tokens (the paper; Ai2 blog). Spans are found over an infini-gram index at O(L * log N) (Ai2 blog), up to 10 enclosing snippets are retrieved per kept span and the documents ranked by BM25, a score that conveys "some notion of relevance" (the paper; Ai2 blog), and the user starts it with the "Show OLMoTrace" button below an answer (Techzine, snippet only). The paper measures 4.46 seconds per query and a first displayed document of 1.90 on a 0–3 relevance scale, roughly "on the same topic" (the paper).

At launch it served OLMo 2 32B and 13B Instruct and OLMoE 1B 7B Instruct and can be applied to any model whose full training data the provider has access to (Ai2 blog; the paper); Ai2's post on X gives the OLMo 3 family (X, snippet only), and Liu expects closed-model providers to hesitate (Ken Yeung).

Its stated purpose is to explore where models "may have learned to generate certain word sequences", verbatim matching taken as the most direct connection (the paper; Ai2 blog), at an early stage of exploring the tool (Ai2 blog).

Its authors show it on fact checking, hallucination and creativity, with case studies on fact checking, "creative" expressions and math (the paper), a memorized math expression and a false knowledge cutoff traced to post-training data (Ai2 blog), and Ai2's leaders tie it to hallucination scores and to auditability (Ken Yeung). Fact checking is stated as a possibility, users "may be able to fact-check the statement against its training data", where context and source help a more informed judgment because some sources are unreliable (the paper, both versions), and confidence follows only if users personally verify that the documents come from trusted sources (Ai2 blog); the newsletter calls it fact-checking, and Liu's launch statement says users can ensure the data supporting their outputs is "trustworthy and verifiable" (Ken Yeung).

The authors' limit: "The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output" (the paper, arXiv v2 and ACL 2025); Ai2 told the newsletter the documents are associations, not the definitive source and not indicators of authority (Ken Yeung).

The paper sets it apart from retrieval-augmented generation, Google AI Overview among RAG's examples: it retrieves post hoc and does not intervene in generation (the paper; Liu in Ken Yeung), and Gemini's double-check is less useful because Search is not Gemini's training data (the paper).

Its 31 authors are at the Allen Institute for AI, the University of Washington, UC Berkeley and Stanford (arXiv; the paper); it is "publicly available and fully open-source", its core under Apache 2.0, the openness Ai2 calls its commitment and Farhadi its condition (arXiv; the paper; Ai2 blog; Ken Yeung). Submitted 9 April 2025 and revised 8 July, it appeared in ACL 2025's System Demonstrations with the Best Demo award (arXiv; ACL Anthology); its authors name the easier exposure of problematic training content as a risk (the paper), and the newsletter finds it gives no analytics for improving data, "generating awareness" (Ken Yeung).

Wikipedia has no article on it (Wikipedia, 2026-10-29).

Provenance — every sentence sourced14 sentences

14 sentences; 51 field claims, 0 archive claims. Modality is the source's own; the prose carries it in its grammar.

1.OLMoTrace is, in its authors' words, "the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time" (arXiv:2504.07096), introduced by Ai2 on 9 April 2025 as a feature of the Ai2 Playground (Ai2 blog).2
  • F1 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s1 documented · field
    We present OLMoTrace, the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time.
  • F2 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶1 documented · field
    Today we introduce OLMoTrace, a one-of-a-kind feature in the Ai2 Playground that lets you trace the outputs of language models back to their full, multi-trillion-token training data in real time.
2.It finds and shows verbatim matches between segments of a model's output and documents in the training corpora, highlighting long and unique spans that occur verbatim at least once in the training data (arXiv abstract; Ai2 blog), and it retrieves by lexical overlap on the heuristic that such documents are likely to be influential (the paper, §6).3
  • F3 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s2 documented · field
    OLMoTrace finds and shows verbatim matches between segments of language model output and documents in the training text corpora.
  • F4 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interact with OLMoTrace' ¶1 documented · field
    The highlights indicate long and unique spans that appear verbatim at least once in the training data of this model.
  • F5 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 Related Work, 'Tracing LM generation into training data' documented · field
    we directly retrieve similar training examples by lexical overlap, with the heuristic that such training examples are likely to be influential for the given output.
3.It matches against the whole of a model's training data, for OLMo-2-32B-Instruct 3.2 billion documents and 4.6 trillion tokens (the paper; Ai2 blog).2
  • F15 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §2 'The training data.' documented · field
    which totals 3.2 billion documents and 4.6 trillion (Llama-2) tokens
  • F16 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶8 documented · field
    In total, these five datasets contain about 3.2 billion documents and 4.6 trillion tokens, and OLMoTrace matches against all of them.
4.Spans are found over an infini-gram index at O(L * log N) (Ai2 blog), up to 10 enclosing snippets are retrieved per kept span and the documents ranked by BM25, a score that conveys "some notion of relevance" (the paper; Ai2 blog), and the user starts it with the "Show OLMoTrace" button below an answer (Techzine, snippet only).4
  • F9 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶3 documented · field
    reducing the time complexity of span finding from the naive O(L^2 * N) to O(L * log N)
  • F10 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §3 Steps 3 and 5 documented · field
    For each kept span, we retrieve up to 10 document snippets from the training data that enclose this span. … we rank all documents by a BM25 score in descending order.
  • F11 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'OLMoTrace behind the scenes' ¶7 documented · field
    We find that this BM25 score conveys some notion of “relevance”, and thus we surface documents with higher scores on top.
  • F12 Techzine Global — Ai2 introduces OLMoTrace: a peek inside LLM's - Techzine Global, card snippet (Techzine unreachable: HTTP 403) documented · field
    After generating an answer from OLMo in the Ai2 Playground, users can activate the tool by clicking the “Show OLMoTrace” button below the output.
5.The paper measures 4.46 seconds per query and a first displayed document of 1.90 on a 0–3 relevance scale, roughly "on the same topic" (the paper).2
  • F13 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §3.2 documented · field
    the OLMoTrace inference latency per query is 4.46 seconds
  • F14 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §4 'Validating the relevance rankings' documented · field
    The first document displayed in each conversation received an average relevance score of 1.90 (roughly meaning “being on the same topic as the LM output)
6.At launch it served OLMo 2 32B and 13B Instruct and OLMoE 1B 7B Instruct and can be applied to any model whose full training data the provider has access to (Ai2 blog; the paper); Ai2's post on X gives the OLMo 3 family (X, snippet only), and Liu expects closed-model providers to hesitate (Ken Yeung).4
  • F17 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶2 documented · field
    OLMoTrace is available today with our three flagship models: OLMo 2 32B Instruct, OLMo 2 13B Instruct, and OLMoE 1B 7B Instruct, and it can be applied to any language model for which you have access to the training data.
  • F19 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶5 documented · field
    OLMoTrace can be applied to any LM as long as the service provider has access to its full training data.
  • F18 X — Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just ... - X, card title and snippet (X unreachable) documented · field
    Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just see its behavior—you can trace it. For example, you can ask Olmo 3-Think (32B
  • F20 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace isn't limited to Ai2's model' documented · field
    However, Liu reasons that closed model providers may hesitate to use OLMoTrace because it would expose the training data to sunlight.
7.Its stated purpose is to explore where models "may have learned to generate certain word sequences", verbatim matching taken as the most direct connection (the paper; Ai2 blog), at an early stage of exploring the tool (Ai2 blog).3
  • F6 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶4 documented · field
    The purpose of OLMoTrace is to give users a tool to explore where LMs may have learned to generate certain word sequences, focusing on verbatim matching as the most direct connection between LM outputs and the training data.
  • F7 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶2 documented · field
    We developed OLMoTrace to enable researchers, developers, and the general public to inspect where and how language models may have learned to generate certain word sequences.
  • F8 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶5 documented · field
    We are still in an early stage in exploring the full potential of this tool
8.Its authors show it on fact checking, hallucination and creativity, with case studies on fact checking, "creative" expressions and math (the paper), a memorized math expression and a false knowledge cutoff traced to post-training data (Ai2 blog), and Ai2's leaders tie it to hallucination scores and to auditability (Ken Yeung).6
  • F21 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s5 documented · field
    We showcase how it can be used to explore fact checking, hallucination, and the creativity of language models.
  • F22 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶4 documented · field
    We present three case studies for ways to use OLMoTrace (§ 5 ): (1) fact checking, (2) tracing the LM-generated “creative” expressions, and (3) tracing math capabilities.
  • F31 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶4 documented · field
    OLMoTrace reveals that this entire expression appears multiple times in the training data, so the model could have easily learned it through memorization.
  • F32 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶5 documented · field
    now we can see that the model may have learned to say August 2023 from the post-training examples listed on the right. This finding led us to remove contents containing knowledge cutoff dates from the 32B model’s post-training data.
  • F30 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace connects the output to the input' (Farhadi) documented · field
    And the minute you start linking the generation to an input—assuming that the inputs were factual—then you can start also cooking up scores for hallucination
  • F33 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'As we start to look towards regulation' (Lebrecht) documented · field
    As we start to look towards regulation, governance, and auditability, there are certain key sectors right now that are limited in what they can deploy at scale with black-box models,
9.Fact checking is stated as a possibility, users "may be able to fact-check the statement against its training data", where context and source help a more informed judgment because some sources are unreliable (the paper, both versions), and confidence follows only if users personally verify that the documents come from trusted sources (Ai2 blog); the newsletter calls it fact-checking, and Liu's launch statement says users can ensure the data supporting their outputs is "trustworthy and verifiable" (Ken Yeung).7
  • F23 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §5 'Fact checking.' documented · field
    If the LM states a fact, users may be able to fact-check the statement against its training data.
  • F24 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, PDF §5 'Fact checking.' documented · field
    If the LM states a fact, users may be able to fact-check the statement against its training data.
  • F25 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §5 'Fact checking.' ¶2 documented · field
    We note that inspecting the document context and source can help users make a more informed judgment on the factuality of the statement, as words can be misleading out of context, and some web sources may be unreliable.
  • F26 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶1 documented · field
    The interpretation of text matches with training data is quite nuanced. For some highlighted spans in the model response, we can use their corresponding documents to fact check claims made in the spans.
  • F27 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, 'Interpreting results' ¶2 documented · field
    If you personally verify that these documents come from trusted sources, you can gain confidence that this piece of information generated by the model is factually correct.
  • F28 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶1 documented · field
    Called OLMoTrace, it's an open-source application offering fact-checking of information provided in prompt replies.
  • F29 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶2 (Liu, in a statement) documented · field
    anyone using our models can ensure that the data supporting their outputs is trustworthy and verifiable.
10.The authors' limit: "The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output" (the paper, arXiv v2 and ACL 2025); Ai2 told the newsletter the documents are associations, not the definitive source and not indicators of authority (Ken Yeung).4
  • F34 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), Limitations documented · field
    OLMoTrace finds lexical, verbatim matches between an LM’s output and its training data. The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output.
  • F35 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, PDF, Limitations documented · field
    The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output.
  • F36 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'Ai2 doesn't intend' (Liu) documented · field
    Ai2 doesn't intend for the documents retrieved to be viewed as the definitive source of the model's learning. "We're just showing you some associations, connections between them. Some of them may warrant a further inspection," Liu clarified.
  • F37 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'In an example where OLMo was asked about the Space Needle' documented · field
    Ai2 asserts that OLMOTrace’s results should not be mistaken as indicators of authority.
11.The paper sets it apart from retrieval-augmented generation, Google AI Overview among RAG's examples: it retrieves post hoc and does not intervene in generation (the paper; Liu in Ken Yeung), and Gemini's double-check is less useful because Search is not Gemini's training data (the paper).3
  • F39 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 'Comparison with RAG.' documented · field
    Examples of them include Bing Chat, Google AI Overview, and Perplexity AI. Despite looking similar, OLMoTrace is fundamentally different from RAG: OLMoTrace retrieves documents post-hoc and does not intervene with the LM generation.
  • F40 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'Liu interjects' (Liu) documented · field
    We are not intervening with the model response. Our response is purely generated by the neural language model.
  • F41 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §6 'Other types of tracing.' documented · field
    the Gemini App has a “double-check response” feature that highlights parts of the LM response and shows similar results from Google Search, which is updated in real time and thus not identical to Gemini’s training data, making it less useful for scientific exploration.
12.Its 31 authors are at the Allen Institute for AI, the University of Washington, UC Berkeley and Stanford (arXiv; the paper); it is "publicly available and fully open-source", its core under Apache 2.0, the openness Ai2 calls its commitment and Farhadi its condition (arXiv; the paper; Ai2 blog; Ken Yeung).6
  • F43 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., title and authors documented · field
    View a PDF of the paper titled OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens, by Jiacheng Liu and 30 other authors
  • F42 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), affiliations documented · field
    α Allen Institute for AI ω University of Washington β UC Berkeley σ Stanford University
  • F45 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., Abstract s6 documented · field
    OLMoTrace is publicly available and fully open-source.
  • F46 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), §1 ¶5 documented · field
    The core part of the system is open-sourced under the Apache 2.0 license.
  • F44 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2, ¶1 documented · field
    OLMoTrace is a manifestation of Ai2’s commitment to an open ecosystem – open models, open data, and beyond.
  • F47 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'OLMoTrace connects the output to the input' (Farhadi) documented · field
    OLMoTrace connects the output to the input, as simple as that. Because our inputs are open, we could actually connect them,
13.Submitted 9 April 2025 and revised 8 July, it appeared in ACL 2025's System Demonstrations with the Best Demo award (arXiv; ACL Anthology); its authors name the easier exposure of problematic training content as a risk (the paper), and the newsletter finds it gives no analytics for improving data, "generating awareness" (Ken Yeung).4
  • F48 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ..., submission history; Comments documented · field
    [Submitted on 9 Apr 2025 (v1), last revised 8 Jul 2025 (this version, v2)] … Comments: ACL 2025 demo track
  • F49 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens, Anthology metadata documented · field
    Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations) … Award: Best Demo
  • F50 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2), Mitigating social and legal risks documented · field
    OLMoTrace can make potentially problematic contents in the LM training data more easily exposed.
  • F38 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info, ¶ 'While Ai2 touts OLMoTrace' documented · field
    OLMoTrace doesn't provide analytics or insights to help developers determine what to do next to improve the training data. Simply put, it's generating awareness.
14.Wikipedia has no article on it (Wikipedia, 2026-10-29).1
  • F51 Wikipedia — OLMoTrace (no article), Wikipedia: titles OLMoTrace and OlmoTrace; article-space search documented · field
    raw wikitext (action=raw, redirect=no), 2026-10-29T17:09:54Z: HTTP 404 … Wikipedia does not have an article with this exact name. … There were no results matching the query.

popup — the compression from the field ledger alone (cards, own page, Wikipedia). With no archive claim admitted, the entry is Ai2's tracing tool at its authors' resolution: its paper in three instances, its launch post, the launch coverage, and its stated limit. composed 2026-10-29 from the field ledger alone; not frozen

Form ledger — AIO against both arms, at both levels
AIO (T)L_F compressionL_F expansionL_A compressionL_A expansion
body words2071596483241388
distinct claims951518990
claims per 100 words4.332.17.927.56.5
field claims carried (of 51)—51515151
archive claims0003839
rail6 documents18 lineagesper sentence28 lineagesper sentence
modality shown innonetypographygrammartypographygrammar

Computed from the row at build: words counted in the text; claims from the ledger ids each line or sentence carries. T's claims are the worked example's T1–T9.

The objects

Tthe transcript207 words · 6 cards

register entry olmotrace-aio-20261029 OBS-3fd20ae244c0 · file as first run sha256 cd5b1c0c59328025…

  • T1-1 definition: 'an open-source system developed by the Allen Institute for Artificial Intelligence (Ai2) that traces language model outputs back to their multi-trillion-token training datasets in real time' (two markers)
  • T1-2 real-time tracing: 'After a model generates a response in the Ai2 Playground, users can click the Show OLMoTrace button to highlight verbatim spans of text.' (two markers)
  • T1-3 source retrieval: 'The tool matches output segments against training corpora (such as the Dolma datasets) and ranks up to 10 context documents using BM25 and unigram probabilities.' (two markers)
  • T1-4 underlying tech: 'It uses an extended version of infini-gram with a parallel algorithm that reduces lookup complexity to \(O(L \log N)\).' (one marker)
  • T1-5 supported models: 'OLMo 2 32B Instruct', 'OLMo 2 13B Instruct', 'OLMoE 1B 7B Instruct', 'OLMo 3 family (including OLMo 3-Think 32B)' (two markers)
  • T1-6 fact-checking: 'Fact-Checking: Verify whether specific claims in a model's answer are backed by real training documents or generated from general parameters.' (two markers)
  • T1-7 hallucination diagnosis: 'Hallucination Diagnosis: Spot where a model mixes up facts or memorized text from source files.' (two markers)
  • T1-8 auditing: 'Auditing & Transparency: Inspect the data recipes and pretraining paths for regulatory compliance or research.' (two markers)
  • T1-9 closer: 'Would you like to know how to access the open-source code for OLMoTrace on GitHub/Hugging Face, or are you looking for details on a specific OLMo model version?'
Bthe disclosed field8 sources
  • B1 Allen Institute for Artificial Intelligence — Going beyond open data – increasing transparency and trust in language models with OLMoTrace | Ai2 card; B1.html sha256 39e59dda3ba78e0b, HTTP 200 at 2026-10-29T17:07:13Z
  • B2 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training ... card; B2.html sha256 cd982680a1ca4c02, HTTP 200 at 2026-10-29T17:07:17Z; byte-identical to the census copy olmotrace--abs
  • B3 ACL Anthology — Tracing Language Model Outputs Back to Trillions of Training Tokens card; B3.html sha256 71292b784f0dc598, HTTP 200 at 2026-10-29T17:07:19Z; PDF sha256 fcac45353235b662
  • B4 X — Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just ... - X unreachable: https://x.com/allen_ai HTTP 200; https://x.com/search?q=%22wired%20into%20OlmoTrace%22 HTTP 200; card title and snippet only
  • B5 Techzine Global — Ai2 introduces OLMoTrace: a peek inside LLM's - Techzine Global unreachable: https://www.techzine.eu/news/analytics/130296/ai2-introduces-olmotrace-a-peek-inside-llms/ HTTP 403; https://www.techzine.eu/news/analytics/130296/ai2-introduces-olmotrace-a-peek-inside-llms/ HTTP 403; https://www.techzine.eu/news/analytics/130296/ai2-introduces-olmotrace-a-peek-inside-llms/ HTTP 403; card title and snippet only
  • B6 The AI Economy | Ken Yeung — Meet OLMoTrace: The Tool That Shows Where AI Gets Its Info card; B6.html sha256 bf021478cec54cb8, HTTP 200 at 2026-10-29T17:07:23Z
  • B7 arXiv — OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens (HTML, v2) own_page; census copy olmotrace--paper (read 2026-10-29, HTTP 200); B7.html sha256 b1b16ba583eeb0db
  • B8 Wikipedia — OLMoTrace (no article) no article: raw HTTP 404, rendered HTTP 404 (after one 429), search no results; sha256 92d530a8e9a8411f
Ethe two entities and their relationρ = extends · equal case

E_A, the archive's entity: the same tool, in the provenance census record and the archive's deposits: a tracing tool in the lineage of training data that records provenance, its object a span of model output and the training documents that contain it verbatim, its relation a verbatim match, its carrier the full training corpus, with the authors' limit as its negative tags (not causes; not a citation system); a member of the class of training-data attribution, which operates on the training/output relation where PER operates on the output/reader relation (#725), traces partially and at cost without recovering authorship (#1714), stands as one post-hoc detection layer in isolation (#127), holds similarity as exploratory evidence (#1075), and supplies the training-data provenance records parametric claims need (#95); whose composition at its own name converts the matching relation into a citation relation (Capture Registry, 2026-10-29) PE-01 PE-02 PE-09 PE-03 PE-04 PE-05 PE-15 PE-16 O725-01 O1714-01 O127-01 O1075-02 O95-01 CAP-1-09; defining papers #725, #95, #1075, #127, #1714

E_F, the field's entity (type C — a conventional reading holds it (public entity: a tracing tool and the paper that presents it)): the system of the Allen Institute for AI with the University of Washington, UC Berkeley and Stanford (Liu, Blanton and 29 others; arXiv:2504.07096, 9 April 2025, v2 8 July 2025; ACL 2025 System Demonstrations, Best Demo) that finds and shows, in the Ai2 Playground and in real time, verbatim matches between long, unique spans of a language model's output and documents in the model's full training data (for OLMo-2-32B-Instruct 3.2 billion documents, 4.6 trillion tokens), over an extended infini-gram index, retrieving up to 10 snippets per span ranked by BM25; its purpose to explore where a model may have learned a word sequence, its uses shown on fact checking (a possibility, conditional on the user's verification of the sources), creativity and math; its stated limit that the documents are not causes of the output, nor supporting evidence or citations for it; set apart from retrieval-augmented generation, Google AI Overview among RAG's examples; applicable to any model whose full training data its provider has access to; open source

ρ = extends: The archive reads OLMoTrace as its authors present it and adds, on the field's own object: the relation the class operates on (training/output) against the one PER measures (output/reader); the cost and partiality of tracing and what it does not recover; its isolation as one survival layer; the evidentiary grade of similarity; the parametric claims it is companion infrastructure for; the census's answer, field by field, to what provenance it carries; and the composition layer's conversion, at its name, of a match into support. O725-01 O1714-01 O1714-02 O127-01 O1075-01 O1075-02 O95-01 PE-21 PE-03 PE-04 CAP-1-04 CAP-1-09. Guard: ρ = extends claims an addition and no more (§1.2a). It does not make the field's sources wrong at their dates. Where an archive claim stands against a field claim (PE-17 against F17/F19, open or accessible training data), both are composed under P_coh within the one ontology. The archive's reading of fact checking at the composition layer (CAP-1-04, CAP-1-09) is composed beside the field's own statements of the use (F21–F29) and of the limit (F34–F37), not in their place.

The case: equal terms, ontology included (v0.9). The archive reads the field's entity as the entity. The provenance census record describes OLMoTrace from its authors' own pages, each field with its basis ('operator'), and answers for it the census's question of what provenance a system carries, through which operation, on whose assertion, with what evidence of survival; the capture record checks the composition against those pages (CAP-1-01–CAP-1-02). No deposit names the tool. The deposits bear on its class, tracing model outputs to training data, and add senses and limits on the field's own object: the training/output relation against PER's output/reader relation (#725), partial tracing at cost that recovers no authorship (#1714), the post-hoc detection layer developed in isolation (#127), similarity as exploratory evidence only (#1075), and the parametric claims such records are companion infrastructure for (#95). #725 states its own relation to the frameworks it places in these terms ('Extension and completion, not substitution or critique'). No defining paper contests the field's ontology of the tool or supplies one the field lacks: ρ = extends, the equal-terms case (§0.9, §1.2a). The archive's reading of the composition, a matching relation converted into a citation relation (CAP-1-09), takes the authors' limit as given and is the field's own distinction carried to the composition layer.

#725 packet header, Relation: **Relation:** Extension and completion, not substitution or critique

#725 §4 table, row 'Data attribution (TRAK, influence functions)': | Data attribution (TRAK, influence functions) | Which training examples shaped a specific output | Adjacent eval method | Operates on training/output relation; PER operates on output/reader relation |

#1714 §9.2 s4–5: The attribution literature shows that partial tracing is possible at cost: influence-function methods estimate which training examples most affect a given output (Grosse et al. 2023). Neither recovers authorship, and both show that what survives depends on what is recorded and computed.

#95 the typology of source-dependent claims: Parametric claims are drawn from the model's training-time parameters rather than runtime retrieval, often without surface signal indicating which sources materially contributed; PER applies to these only indirectly, and addressing them at the substrate level requires companion infrastructure (training-data provenance records, watermarking, content credentials).

#PE census.json organizing_question: What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?

#PE census.json rows[slug == 'olmotrace'].provenance_object: a span of a language model's output and the training documents that contain it verbatim

#capture-registry olmotrace-aio-20261029, analysis s2: The composition turns a trace of verbatim overlap into evidence for a claim, the conversion of a matching relation into a citation relation that the paper names and refuses.

τthe translation: every field claim carried, beside its statement in the archive's ontology51 field claims · 18 rows
field claimsreceivedreceiving texttranslationarchive
F1, F2F1 (B2, Abstract s1): "We present OLMoTrace, the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time."; F2 (B1, ¶1): "Today we introduce OLMoTrace, a one-of-a-kind feature in the Ai2 Playground that lets you trace the outputs of language models back to their full, multi-trillion-token training data in real time."—untranslated: composed as received beside PE-01, PE-02PE-01, PE-02
F3, F4, F5F3 (B2, Abstract s2): "OLMoTrace finds and shows verbatim matches between segments of language model output and documents in the training text corpora."; F4 (B1, 'Interact with OLMoTrace' ¶1): "The highlights indicate long and unique spans that appear verbatim at least once in the training data of this model."; F5 (B7, §6 Related Work, 'Tracing LM generation into training data'): "we directly retrieve similar training examples by lexical overlap, with the heuristic that such training examples are likely to be influential for the given output."—untranslated: composed as received beside PE-03, PE-04, PE-10PE-03, PE-04, PE-10
F6, F7, F8F6 (B7, §1 ¶4): "The purpose of OLMoTrace is to give users a tool to explore where LMs may have learned to generate certain word sequences, focusing on verbatim matching as the most direct connection between LM outputs and the training data."; F7 (B1, ¶2): "We developed OLMoTrace to enable researchers, developers, and the general public to inspect where and how language models may have learned to generate certain word sequences."; F8 (B1, 'Interpreting results' ¶5): "We are still in an early stage in exploring the full potential of this tool"—untranslated: composed as received (no archive claim in its lineage)
F9, F10, F11, F12F9 (B1, 'OLMoTrace behind the scenes' ¶3): "reducing the time complexity of span finding from the naive O(L^2 N) to O(L log N)"; F10 (B7, §3 Steps 3 and 5): "For each kept span, we retrieve up to 10 document snippets from the training data that enclose this span. … we rank all documents by a BM25 score in descending order."; F11 (B1, 'OLMoTrace behind the scenes' ¶7): "We find that this BM25 score conveys some notion of “relevance”, and thus we surface documents with higher scores on top."; F12 (B5, card snippet (Techzine unreachable: HTTP 403)): "After generating an answer from OLMo in the Ai2 Playground, users can activate the tool by clicking the “Show OLMoTrace” button below the output."—untranslated: composed as received beside PE-05, PE-06PE-05, PE-06
F13, F14F13 (B7, §3.2): "the OLMoTrace inference latency per query is 4.46 seconds"; F14 (B7, §4 'Validating the relevance rankings'): "The first document displayed in each conversation received an average relevance score of 1.90 (roughly meaning “being on the same topic as the LM output)"—untranslated: composed as received (no archive claim in its lineage)
F15, F16F15 (B7, §2 'The training data.'): "which totals 3.2 billion documents and 4.6 trillion (Llama-2) tokens"; F16 (B1, 'OLMoTrace behind the scenes' ¶8): "In total, these five datasets contain about 3.2 billion documents and 4.6 trillion tokens, and OLMoTrace matches against all of them."—untranslated: composed as received beside PE-07PE-07
F17, F18, F19, F20F17 (B1, ¶2): "OLMoTrace is available today with our three flagship models: OLMo 2 32B Instruct, OLMo 2 13B Instruct, and OLMoE 1B 7B Instruct, and it can be applied to any language model for which you have access to the training data."; F18 (B4, card title and snippet (X unreachable)): "Olmo 3 is wired into OlmoTrace in the Ai2 Playground, so you don't just see its behavior—you can trace it. For example, you can ask Olmo 3-Think (32B"; F19 (B7, §1 ¶5): "OLMoTrace can be applied to any LM as long as the service provider has access to its full training data."; F20 (B6, ¶ 'OLMoTrace isn't limited to Ai2's model'): "However, Liu reasons that closed model providers may hesitate to use OLMoTrace because it would expose the training data to sunlight."—untranslated: composed as received beside CAP-1-06, CAP-1-07, PE-17CAP-1-06, CAP-1-07, PE-17
F21, F22, F30, F31, F32F21 (B2, Abstract s5): "We showcase how it can be used to explore fact checking, hallucination, and the creativity of language models."; F22 (B7, §1 ¶4): "We present three case studies for ways to use OLMoTrace (§ 5 ): (1) fact checking, (2) tracing the LM-generated “creative” expressions, and (3) tracing math capabilities."; F30 (B6, ¶ 'OLMoTrace connects the output to the input' (Farhadi)): "And the minute you start linking the generation to an input—assuming that the inputs were factual—then you can start also cooking up scores for hallucination"; F31 (B1, 'Interpreting results' ¶4): "OLMoTrace reveals that this entire expression appears multiple times in the training data, so the model could have easily learned it through memorization."; F32 (B1, 'Interpreting results' ¶5): "now we can see that the model may have learned to say August 2023 from the post-training examples listed on the right. This finding led us to remove contents containing knowledge cutoff dates from the 32B model’s post-training data."—untranslated: composed as received (no archive claim in its lineage)
F23, F24, F25, F26, F27, F28, F29F23 (B7, §5 'Fact checking.'): "If the LM states a fact, users may be able to fact-check the statement against its training data."; F24 (B3, PDF §5 'Fact checking.'): "If the LM states a fact, users may be able to fact-check the statement against its training data."; F25 (B7, §5 'Fact checking.' ¶2): "We note that inspecting the document context and source can help users make a more informed judgment on the factuality of the statement, as words can be misleading out of context, and some web sources may be unreliable."; F26 (B1, 'Interpreting results' ¶1): "The interpretation of text matches with training data is quite nuanced. For some highlighted spans in the model response, we can use their corresponding documents to fact check claims made in the spans."; F27 (B1, 'Interpreting results' ¶2): "If you personally verify that these documents come from trusted sources, you can gain confidence that this piece of information generated by the model is factually correct."; F28 (B6, ¶1): "Called OLMoTrace, it's an open-source application offering fact-checking of information provided in prompt replies."; F29 (B6, ¶2 (Liu, in a statement)): "anyone using our models can ensure that the data supporting their outputs is trustworthy and verifiable."—untranslated: composed as received (no archive claim in its lineage)
F33F33 (B6, ¶ 'As we start to look towards regulation' (Lebrecht)): "As we start to look towards regulation, governance, and auditability, there are certain key sectors right now that are limited in what they can deploy at scale with black-box models,"—untranslated: composed as received (no archive claim in its lineage)
F34, F35, F36, F37F34 (B7, Limitations): "OLMoTrace finds lexical, verbatim matches between an LM’s output and its training data. The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output."; F35 (B3, PDF, Limitations): "The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output."; F36 (B6, ¶ 'Ai2 doesn't intend' (Liu)): "Ai2 doesn't intend for the documents retrieved to be viewed as the definitive source of the model's learning. "We're just showing you some associations, connections between them. Some of them may warrant a further inspection," Liu clarified."; F37 (B6, ¶ 'In an example where OLMo was asked about the Space Needle'): "Ai2 asserts that OLMOTrace’s results should not be mistaken as indicators of authority."—untranslated: composed as received beside CAP-1-03, PE-11, PE-15, PE-16CAP-1-03, PE-11, PE-15, PE-16
F38F38 (B6, ¶ 'While Ai2 touts OLMoTrace'): "OLMoTrace doesn't provide analytics or insights to help developers determine what to do next to improve the training data. Simply put, it's generating awareness."—untranslated: composed as received (no archive claim in its lineage)
F39, F40, F41F39 (B7, §6 'Comparison with RAG.'): "Examples of them include Bing Chat, Google AI Overview, and Perplexity AI. Despite looking similar, OLMoTrace is fundamentally different from RAG: OLMoTrace retrieves documents post-hoc and does not intervene with the LM generation."; F40 (B6, ¶ 'Liu interjects' (Liu)): "We are not intervening with the model response. Our response is purely generated by the neural language model."; F41 (B7, §6 'Other types of tracing.'): "the Gemini App has a “double-check response” feature that highlights parts of the LM response and shows similar results from Google Search, which is updated in real time and thus not identical to Gemini’s training data, making it less useful for scientific exploration."—untranslated: composed as received (no archive claim in its lineage)
F42, F43F42 (B7, affiliations): "α Allen Institute for AI ω University of Washington β UC Berkeley σ Stanford University"; F43 (B2, title and authors): "View a PDF of the paper titled OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens, by Jiacheng Liu and 30 other authors"—untranslated: composed as received beside CAP-1-05, PE-08CAP-1-05, PE-08
F44, F45, F46, F47F44 (B1, ¶1): "OLMoTrace is a manifestation of Ai2’s commitment to an open ecosystem – open models, open data, and beyond."; F45 (B2, Abstract s6): "OLMoTrace is publicly available and fully open-source."; F46 (B7, §1 ¶5): "The core part of the system is open-sourced under the Apache 2.0 license."; F47 (B6, ¶ 'OLMoTrace connects the output to the input' (Farhadi)): "OLMoTrace connects the output to the input, as simple as that. Because our inputs are open, we could actually connect them,"—untranslated: composed as received beside PE-12PE-12
F48, F49F48 (B2, submission history; Comments): "[Submitted on 9 Apr 2025 (v1), last revised 8 Jul 2025 (this version, v2)] … Comments: ACL 2025 demo track"; F49 (B3, Anthology metadata): "Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations) … Award: Best Demo"—untranslated: composed as received beside PE-13, PE-14PE-13, PE-14
F50F50 (B7, Mitigating social and legal risks): "OLMoTrace can make potentially problematic contents in the LM training data more easily exposed."—untranslated: composed as received (no archive claim in its lineage)
F51F51 (B8, Wikipedia: titles OLMoTrace and OlmoTrace; article-space search): "raw wikitext (action=raw, redirect=no), 2026-10-29T17:09:54Z: HTTP 404 … Wikipedia does not have an article with this exact name. … There were no results matching the query."—untranslated: composed as received (no archive claim in its lineage)

equal-terms case: every field claim composed as received, beside the archive claims it stands with. Reading the received column recovers the field (§5.9).

R7the measure0 of 14 survive

v0.9 §4.10: KO_B sentences surviving in the KO at similarity ≥ 0.95, with positions (computed as apply_v09.py does: difflib.SequenceMatcher ratio, the best KO sentence for each KO_B sentence): v0.9 0 of 14 (positions [None, None, None, None, None, None, None, None, None, None, None, None, None, None]; composed first under v0.9, so there is no v0.7 object to measure against). Opening-run check (§5.10): no breach.

L_F(B)recomposed from the disclosed field, in the field's ontology648 words

OLMoTrace is, in its authors' words, "the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time" (arXiv:2504.07096), introduced by Ai2 on 9 April 2025 as a feature of the Ai2 Playground (Ai2 blog). It finds and shows verbatim matches between segments of a model's output and documents in the training corpora, highlighting long and unique spans that occur verbatim at least once in the training data (arXiv abstract; Ai2 blog), and it retrieves by lexical overlap on the heuristic that such documents are likely to be influential (the paper, §6). It matches against the whole of a model's training data, for OLMo-2-32B-Instruct 3.2 billion documents and 4.6 trillion tokens (the paper; Ai2 blog). Spans are found over an infini-gram index at O(L * log N) (Ai2 blog), up to 10 enclosing snippets are retrieved per kept span and the documents ranked by BM25, a score that conveys "some notion of relevance" (the paper; Ai2 blog), and the user starts it with the "Show OLMoTrace" button below an answer (Techzine, snippet only). The paper measures 4.46 seconds per query and a first displayed document of 1.90 on a 0–3 relevance scale, roughly "on the same topic" (the paper). At launch it served OLMo 2 32B and 13B Instruct and OLMoE 1B 7B Instruct and can be applied to any model whose full training data the provider has access to (Ai2 blog; the paper); Ai2's post on X gives the OLMo 3 family (X, snippet only), and Liu expects closed-model providers to hesitate (Ken Yeung). Its stated purpose is to explore where models "may have learned to generate certain word sequences", verbatim matching taken as the most direct connection (the paper; Ai2 blog), at an early stage of exploring the tool (Ai2 blog). Its authors show it on fact checking, hallucination and creativity, with case studies on fact checking, "creative" expressions and math (the paper), a memorized math expression and a false knowledge cutoff traced to post-training data (Ai2 blog), and Ai2's leaders tie it to hallucination scores and to auditability (Ken Yeung). Fact checking is stated as a possibility, users "may be able to fact-check the statement against its training data", where context and source help a more informed judgment because some sources are unreliable (the paper, both versions), and confidence follows only if users personally verify that the documents come from trusted sources (Ai2 blog); the newsletter calls it fact-checking, and Liu's launch statement says users can ensure the data supporting their outputs is "trustworthy and verifiable" (Ken Yeung). The authors' limit: "The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output" (the paper, arXiv v2 and ACL 2025); Ai2 told the newsletter the documents are associations, not the definitive source and not indicators of authority (Ken Yeung). The paper sets it apart from retrieval-augmented generation, Google AI Overview among RAG's examples: it retrieves post hoc and does not intervene in generation (the paper; Liu in Ken Yeung), and Gemini's double-check is less useful because Search is not Gemini's training data (the paper). Its 31 authors are at the Allen Institute for AI, the University of Washington, UC Berkeley and Stanford (arXiv; the paper); it is "publicly available and fully open-source", its core under Apache 2.0, the openness Ai2 calls its commitment and Farhadi its condition (arXiv; the paper; Ai2 blog; Ken Yeung). Submitted 9 April 2025 and revised 8 July, it appeared in ACL 2025's System Demonstrations with the Best Demo award (arXiv; ACL Anthology); its authors name the easier exposure of problematic training content as a risk (the paper), and the newsletter finds it gives no analytics for improving data, "generating awareness" (Ken Yeung). Wikipedia has no article on it (Wikipedia, 2026-10-29).

L_A(B ∪ A)the field and the archive composed in the archive's ontology1388 words

OLMoTrace is a tracing tool in the census's lineage of training data, attaching provenance to "a span of a language model's output and the training documents that contain it verbatim" (provenance census record), and its authors present it as "the first system that traces the outputs of language models back to their full, multi-trillion-token training data in real time" (arXiv:2504.07096). Ai2 introduced it on 9 April 2025 as a feature of the Ai2 Playground (Ai2 blog), and the census answers its organizing question for it, "What provenance does this system carry, through which operation, on whose assertion, with what evidence of survival?", field by field (census record). The relation it carries is a verbatim match: it "finds and shows verbatim matches between segments of language model output and documents in the training text corpora" (arXiv abstract), highlighting long and unique spans found at least once in the training data (Ai2 blog), which the census records as its one relation type, its operation (model generation traced back to training text) and its unit, "a maximal matching span of model output" (census record). It retrieves "by lexical overlap, with the heuristic that such training examples are likely to be influential for the given output" (the paper, §6); for the class of training-data attribution, which treats model behaviour as counterfactually dependent on the examples that entered training, the archive's protocol ranks exact paired retraining first, validated approximation second, and "unvalidated similarity or intuition only as exploratory evidence" (#1075). Its carrier is the model's full training corpus over an extended infini-gram index (census record): for OLMo-2-32B-Instruct, 3.2 billion documents and 4.6 trillion tokens across pre-, mid- and post-training, all of them matched (the paper; Ai2 blog; census record). Span finding runs at O(L * log N) (Ai2 blog); up to 10 enclosing snippets are retrieved per kept span and ranked by BM25 (the paper), a score that conveys "some notion of relevance" (Ai2 blog), behind a "Show OLMoTrace" button below the model's answer (Techzine, snippet only). Per query the tracing takes 4.46 seconds on average, and the first document it displays averages 1.90 on a 0–3 relevance scale, roughly "on the same topic" as the output, in the paper's own measurement (the paper). At launch it served OLMo 2 32B and 13B Instruct and OLMoE 1B 7B Instruct and "can be applied to any language model for which you have access to the training data" (Ai2 blog), "as long as the service provider has access to its full training data" (the paper); Ai2's post on X gives the OLMo 3 family (X, snippet only), which the Capture Registry finds the census record does not yet carry and is to carry from Ai2's own page (Capture Registry, 2026-10-29). The census tags it as tracing "only models whose training data is open" (census record); Farhadi ties the connection to Ai2's open inputs, and Liu expects closed-model providers to hesitate because the tool would expose their training data (Ken Yeung). Its purpose, in the paper, is to explore where models "may have learned to generate certain word sequences", verbatim matching taken as "the most direct connection between LM outputs and the training data" (the paper), for researchers, developers and the general public (Ai2 blog), at "an early stage" of exploring the tool (Ai2 blog). The archive places the class this tool belongs to on the training/output relation: data attribution asks "Which training examples shaped a specific output", an adjacent method that "Operates on training/output relation; PER operates on output/reader relation" (#725). Of that class the archive holds that partial tracing "is possible at cost", that it does not recover authorship, and that "what survives depends on what is recorded and computed" (#1714), and that training-data attribution is the post-hoc detection layer, developed "in isolation" from the other survival layers, no system bundling them (#127). Claims drawn from a model's training-time parameters, on the archive's typology, often carry no surface signal of the sources that contributed; PER reaches them only indirectly, and the substrate level needs companion infrastructure, "training-data provenance records" among it (#95), since provenance "has to survive the training pipeline" (#1714). Its authors show it on "fact checking, hallucination, and the creativity of language models" (arXiv abstract), with three case studies, fact checking first (the paper), and Ai2's post traces a math expression the model could have learned by memorization and a false knowledge cutoff to post-training examples, a finding that changed the 32B model's post-training data (Ai2 blog). Fact checking stands in the paper as a possibility, users "may be able to fact-check the statement against its training data", with its qualification that context and source help "a more informed judgment on the factuality of the statement", since words mislead out of context and some web sources are unreliable (the paper, arXiv v2 and ACL 2025). Ai2's post calls the interpretation of matches "quite nuanced" and makes confidence in a generated fact conditional on the user's own check that the documents "come from trusted sources" (Ai2 blog); the newsletter calls it an application "offering fact-checking", and Liu's launch statement says users "can ensure that the data supporting their outputs is trustworthy and verifiable" (Ken Yeung). The authors state the limit in both versions of the paper, "The retrieved documents should not be interpreted as having a causal effect on the LM output, or as supporting evidence or citations for the LM output" (the paper; ACL 2025), and the census carries it as two negative tags, not causes of the output and "NOT a citation system", and in what it records as surviving (census record). To the newsletter Ai2 called the documents associations, not "the definitive source of the model's learning", and its results not "indicators of authority" (Ken Yeung). Ai2's leaders tie the tool to hallucination scores, "assuming that the inputs were factual" (Farhadi), and to regulation, governance and auditability (Lebrecht), in the newsletter's report (Ken Yeung). The paper sets it apart from retrieval-augmented generation, naming Google AI Overview among RAG's examples: OLMoTrace "retrieves documents post-hoc and does not intervene with the LM generation" (the paper; Liu in Ken Yeung), and Gemini's double-check, drawn from Search and not from Gemini's training data, is "less useful for scientific exploration" (the paper). At its own name on Google's AI Overview, 2026-10-29, the composition held the tool, its maker, its real time, its scale and its verbatim matching, checked against the census record and the pages it saved, naming the tool, its method, its models and its uses (Capture Registry, 2026-10-29), and gave as its first use "Fact-Checking: Verify whether specific claims in a model's answer are backed by real training documents", a verbatim match "offered as support for a claim, the reading the paper excludes" (Capture Registry, 2026-10-29). The registry reads this as "the conversion of a matching relation into a citation relation that the paper names and refuses", a tool whose authors state what a match does not mean "composed with that meaning restored", and it finds the census record's negative tags to be the authors' own (Capture Registry, 2026-10-29). Its 31 authors are at the Allen Institute for AI, the University of Washington, UC Berkeley and Stanford (arXiv; the paper), the operator the census records whole (census record), where the composition named Ai2 alone (Capture Registry, 2026-10-29). It is "publicly available and fully open-source" (arXiv abstract), its core under the Apache 2.0 license (the paper), reached through the Ai2 Playground (census record), an expression of Ai2's commitment to "open models, open data, and beyond" (Ai2 blog). Submitted 9 April 2025 and revised 8 July (arXiv; census record), it appeared in ACL 2025's System Demonstrations with the Best Demo award (ACL Anthology), and the census records it active, "ACL 2025 demo track" (census record). Its authors name as a risk that it makes problematic training content "more easily exposed" (the paper), and the newsletter finds that it gives no analytics for improving the data: "Simply put, it's generating awareness" (Ken Yeung). The census records the tool as one that records provenance, a neighbour of the Data Provenance Initiative, with the Playground and "infini-gram as a separate record" left unchecked (census record); no card cites the record, which landed the same day (Capture Registry, 2026-10-29), and Wikipedia has no article on OLMoTrace (Wikipedia, 2026-10-29).

Δthe delta

T against L_F(B) (AIO's ontology at work on its own cards): At 'OLMoTrace' (T1, six cards: B1–B6, B4 and B5 unreachable; 207 words) the composition gives the tool by its authors' abstract and launch post. Composed from its cards: the definition at the abstract's and the post's grain (B2 F1, B1 F2: tracing outputs back to multi-trillion-token training data in real time; 'full' dropped), Ai2 as maker (B1) with the partners left out (B2 F43 names 31 authors; the affiliations are on B7 F42, the paper the cards link to: CAP-1-05); open source (B2 F45); the button and the verbatim spans (B5 F12, snippet; B1 F4); the index and its complexity (B1 F9); up to 10 documents ranked by BM25 (B1, the post's text of the pipeline; B7 F10); the models (B1 F17, B4 F18 for OLMo 3, the X snippet, CAP-1-06); the uses at the abstract's and the newsletter's grain (B2 F21 'fact checking, hallucination'; B6 F28 'offering fact-checking'; B1 F31 memorization; B6 F33 regulation and auditability). Force raised: the fact-checking use. The field states it as a possibility, 'users may be able to fact-check the statement against its training data' (B3 F24, the card's own paper; B7 F23), qualified by context and source (B7 F25), conditioned in the operator's post on the user personally verifying that the documents 'come from trusted sources' (B1 F27) and called 'quite nuanced' (B1 F26); T composes 'Verify whether specific claims in a model's answer are backed by real training documents', an imperative of support. Limit dropped: the authors' limit, in the card's own paper, that the documents are not 'supporting evidence or citations for the LM output' (B3 F35; B7 F34), and Ai2's statements to the newsletter that they are associations and not 'indicators of authority' (B6 F36, F37): none is composed. The strongest form of the use in the field is Liu's launch statement, users 'can ensure that the data supporting their outputs is trustworthy and verifiable' (B6 F29, attributed); T's 'backed by' stands nearer to it than to the paper, at no attribution. The capture's findings name the same move at their own grain: 'A verbatim match is offered as support for a claim, the reading the paper excludes' (CAP-1-04), 'the conversion of a matching relation into a citation relation that the paper names and refuses' (CAP-1-09). Read against the field whole, fact checking is the authors' own first use (B2 F21; B7 F22) and what the paper excludes is reading the matched documents as causes, evidence or citations: the excess of T is the support relation and the dropped limit, not the use. Substituted reading: T's 'ranks up to 10 context documents using BM25 and unigram probabilities' joins two steps the field keeps apart (the span unigram probability filters spans, B1 'OLMoTrace behind the scenes' ¶4; BM25 ranks documents, B7 F10). Outside the cards: 'such as the Dolma datasets' (no field source names Dolma; the paper's own page, not surfaced, names olmo-mix-1124 and dolmino-mix-1124); 'or generated from general parameters' (no field source makes the dichotomy; the archive's typology of parametric claims, O95-01, bears on it); 'mixes up facts' and 'data recipes and pretraining paths' (no field source). Available, not composed: the count (B1 F16), the purpose (B1 F7), the early stage (B1 F8), the hedge on relevance (B1 F11), the condition of access and the closed providers (B1 F17 in part; B6 F20, F47), the knowledge-cutoff finding (B1 F32), Farhadi's conditional (B6 F30), the contrast with retrieval (B6 F40), the openness as commitment (B1 F44), the publication and its Best Demo award (B2 F48, B3 F49), the newsletter's assessment (B6 F38). Composed without attribution: everything; no person is named, at the coarse grain of a tool description (recorded, not a breach), except the use, which is composed at the grain of a support relation no card states for the documents (recorded as force raised). Content replaced by use: the closer (T1-9).

v0.9 §0.5: the first diff is ontological and narrow. T and the field agree on the entity (Ai2's tool that finds training text verbatim in a model's answer). T composes the tool and its uses and leaves out the one sentence its authors attach to what the tool returns: that a match is not a cause, not evidence, not a citation. With the limit gone, the matching relation is composed as a support relation.

L_F(B) against L_A(B ∪ A) (the intervention): Admission adds, in one claim space with the field's: the class's relation, training/output and not output/reader, where PER operates (O725-01); partial tracing possible at cost, recovering no authorship, what survives depending on what is recorded and computed (O1714-01), provenance that has to survive the training pipeline (O1714-02); training-data attribution as the post-hoc detection layer, developed in isolation from the other survival layers (O127-01); the archive's evidentiary hierarchy for training-data attribution, with unvalidated similarity as exploratory evidence only (O1075-01, O1075-02), set beside the paper's heuristic of lexical overlap (F5); parametric claims, which carry no surface signal of their sources and need training-data provenance records at the substrate level (O95-01); the provenance census record's answer to its organizing question, field by field with its basis (PE-01–PE-21), its tag 'traces only models whose training data is open' held against the field's condition of access (PE-17 against F17, F19); and the Capture Registry's account of the composition at the name (CAP-1-01–CAP-1-11). Not surfaced: every archive source; no card cites the census record (CAP-1-11).

alignment: {'T1_cards_claims': ['F1', 'F2', 'F3', 'F4', 'F7', 'F8', 'F9', 'F11', 'F12', 'F16', 'F17', 'F18', 'F20', 'F21', 'F24', 'F26', 'F27', 'F28', 'F29', 'F30', 'F31', 'F32', 'F33', 'F35', 'F36', 'F37', 'F38', 'F40', 'F43', 'F44', 'F45', 'F47', 'F48', 'F49'], 'T1_composed': ['F1', 'F2', 'F3', 'F4', 'F9', 'F10', 'F12', 'F17', 'F18', 'F21', 'F24', 'F28', 'F31', 'F33', 'F45'], 'T1_outside_cards': ["'such as the Dolma datasets' (no field source; B7, own page not surfaced, names olmo-mix-1124 and dolmino-mix-1124)", "'or generated from general parameters' (no field source)", "'mixes up facts' (no field source)", "'data recipes and pretraining paths' (no field source)"], 'rule': "a field claim counts as composed when T states it at its source's grain or coarser; the typology of what is not is in T_vs_LB (§6.2)"}

Kthe prospective kernel sealed only at freeze39 entries
K1O725-01 #725missing distinction (the field has no claim on the point)
claim
O725-01
source
#725
M_src
interpretation
sense
two relations: training/output and output/reader
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K2O95-01 #95missing distinction (the field has no claim on the point)
claim
O95-01
source
#95
M_src
interpretation
sense
parametric claims and training-data provenance
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K3O1075-01 #1075qualified claim: F5 (the paper's heuristic of lexical overlap as likely influence)
claim
O1075-01
source
#1075
M_src
interpretation
sense
the evidentiary hierarchy for training-data attribution
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
qualified claim: F5 (the paper's heuristic of lexical overlap as likely influence)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K4O1075-02 #1075qualified claim: F5 (the paper's heuristic of lexical overlap as likely influence)
claim
O1075-02
source
#1075
M_src
definition
sense
the evidentiary hierarchy for training-data attribution
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
qualified claim: F5 (the paper's heuristic of lexical overlap as likely influence)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K5O127-01 #127missing distinction (the field has no claim on the point)
claim
O127-01
source
#127
M_src
interpretation
sense
post-hoc detection: one survival layer, developed in isolation
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K6O1714-01 #1714qualified claim: F5 (the paper's heuristic of lexical overlap as likely influence)
claim
O1714-01
source
#1714
M_src
interpretation
sense
partial tracing at cost; what survives depends on what is recorded
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
qualified claim: F5 (the paper's heuristic of lexical overlap as likely influence)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K7O1714-02 #1714missing distinction (the field has no claim on the point)
claim
O1714-02
source
#1714
M_src
interpretation
sense
partial tracing at cost; what survives depends on what is recorded
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K8CAP-1-01 Capture Registry, 2026-10-29missing finding (an observation of the composition at the entity's address)
claim
CAP-1-01
source
Capture Registry, 2026-10-29
M_src
documented
sense
the composition at the name: what it held
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing finding (an observation of the composition at the entity's address)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K9CAP-1-02 Capture Registry, 2026-10-29missing finding (an observation of the composition at the entity's address)
claim
CAP-1-02
source
Capture Registry, 2026-10-29
M_src
documented
sense
the composition at the name: what it held
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing finding (an observation of the composition at the entity's address)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K10CAP-1-03 Capture Registry, 2026-10-29missing finding (an observation of the composition at the entity's address)
claim
CAP-1-03
source
Capture Registry, 2026-10-29
M_src
documented
sense
the stated limit: not causes, not evidence, not citations
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing finding (an observation of the composition at the entity's address)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K11CAP-1-04 Capture Registry, 2026-10-29qualified claim: F21, F22, F23, F28, F29 (fact checking as the field states it)
claim
CAP-1-04
source
Capture Registry, 2026-10-29
M_src
interpretation
sense
the composition converts a match into support
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
qualified claim: F21, F22, F23, F28, F29 (fact checking as the field states it)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K12CAP-1-05 Capture Registry, 2026-10-29missing finding (an observation of the composition at the entity's address)
claim
CAP-1-05
source
Capture Registry, 2026-10-29
M_src
documented
sense
the operator and the authors
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing finding (an observation of the composition at the entity's address)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K13CAP-1-06 Capture Registry, 2026-10-29missing finding (an observation of the composition at the entity's address)
claim
CAP-1-06
source
Capture Registry, 2026-10-29
M_src
documented
sense
models and applicability
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing finding (an observation of the composition at the entity's address)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K14CAP-1-07 Capture Registry, 2026-10-29missing finding (an observation of the composition at the entity's address)
claim
CAP-1-07
source
Capture Registry, 2026-10-29
M_src
stipulation
sense
models and applicability
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing finding (an observation of the composition at the entity's address)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K15CAP-1-08 Capture Registry, 2026-10-29qualified claim: F21, F22, F23, F28, F29 (fact checking as the field states it)
claim
CAP-1-08
source
Capture Registry, 2026-10-29
M_src
interpretation
sense
the composition converts a match into support
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
qualified claim: F21, F22, F23, F28, F29 (fact checking as the field states it)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K16CAP-1-09 Capture Registry, 2026-10-29qualified claim: F21, F22, F23, F28, F29 (fact checking as the field states it)
claim
CAP-1-09
source
Capture Registry, 2026-10-29
M_src
interpretation
sense
the composition converts a match into support
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
qualified claim: F21, F22, F23, F28, F29 (fact checking as the field states it)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K17CAP-1-10 Capture Registry, 2026-10-29missing finding (an observation of the composition at the entity's address)
claim
CAP-1-10
source
Capture Registry, 2026-10-29
M_src
interpretation
sense
the composition at the name: what it held
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing finding (an observation of the composition at the entity's address)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K18CAP-1-11 Capture Registry, 2026-10-29missing finding (an observation of the composition at the entity's address)
claim
CAP-1-11
source
Capture Registry, 2026-10-29
M_src
documented
sense
reception: the record and the cards
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing finding (an observation of the composition at the entity's address)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K19PE-01 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-01
source
provenance census record, 2026-10-29
M_src
stipulation
sense
what it is: tracing model output to its training data in real time
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K20PE-02 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-02
source
provenance census record, 2026-10-29
M_src
stipulation
sense
what it is: tracing model output to its training data in real time
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K21PE-03 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-03
source
provenance census record, 2026-10-29
M_src
stipulation
sense
the relation: verbatim match between output and training text
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K22PE-04 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-04
source
provenance census record, 2026-10-29
M_src
stipulation
sense
the relation: verbatim match between output and training text
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K23PE-05 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-05
source
provenance census record, 2026-10-29
M_src
stipulation
sense
the pipeline: spans, index, retrieval, ranking
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K24PE-06 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-06
source
provenance census record, 2026-10-29
M_src
stipulation
sense
the pipeline: spans, index, retrieval, ranking
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K25PE-07 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-07
source
provenance census record, 2026-10-29
M_src
attributed
sense
the training data and its count
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K26PE-08 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-08
source
provenance census record, 2026-10-29
M_src
attributed
sense
the operator and the authors
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K27PE-09 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-09
source
provenance census record, 2026-10-29
M_src
stipulation
sense
what the record's schema asks
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K28PE-10 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-10
source
provenance census record, 2026-10-29
M_src
stipulation
sense
the relation: verbatim match between output and training text
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K29PE-11 provenance census record, 2026-10-29none (restates F34/F35, one lineage)
claim
PE-11
source
provenance census record, 2026-10-29
M_src
attributed
sense
the stated limit: not causes, not evidence, not citations
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
none (restates F34/F35, one lineage)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K30PE-12 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-12
source
provenance census record, 2026-10-29
M_src
attributed
sense
openness
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K31PE-13 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-13
source
provenance census record, 2026-10-29
M_src
documented
sense
publication
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K32PE-14 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-14
source
provenance census record, 2026-10-29
M_src
documented
sense
publication
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K33PE-15 provenance census record, 2026-10-29none (restates F34/F35, one lineage)
claim
PE-15
source
provenance census record, 2026-10-29
M_src
attributed
sense
the stated limit: not causes, not evidence, not citations
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
none (restates F34/F35, one lineage)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K34PE-16 provenance census record, 2026-10-29none (restates F34/F35, one lineage)
claim
PE-16
source
provenance census record, 2026-10-29
M_src
stipulation
sense
the stated limit: not causes, not evidence, not citations
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
none (restates F34/F35, one lineage)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K35PE-17 provenance census record, 2026-10-29rival claim: F17, F19 (the condition is access to the full training data)
claim
PE-17
source
provenance census record, 2026-10-29
M_src
stipulation
sense
models and applicability
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
rival claim: F17, F19 (the condition is access to the full training data)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K36PE-18 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-18
source
provenance census record, 2026-10-29
M_src
stipulation
sense
neighbours in the census
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K37PE-19 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-19
source
provenance census record, 2026-10-29
M_src
self-description
sense
what the record's schema asks
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K38PE-20 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-20
source
provenance census record, 2026-10-29
M_src
self-description
sense
what the record's schema asks
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
K39PE-21 provenance census record, 2026-10-29missing distinction (the field has no claim on the point)
claim
PE-21
source
provenance census record, 2026-10-29
M_src
stipulation
sense
what the record's schema asks
qualifiers carried
—
f (source's own falsifiers)
— (none stated; watch: a later composition at the address that states or drops the claim, attributed or not, uptake §8.3)
contrast
missing distinction (the field has no claim on the point)
resolver
a later capture at 'OLMoTrace' (ADDR-435813c322c8) on Google AI Overview, seated in the Capture Registry (§8.3)
Archive bearing — D/R/O traversalread

Candidates are found by string; admission is by reading.

traversalfirst reading, 2026-10-29; second pass with one citation hop
D 0 deposits · 0 sentencesR 0 · 0O 4 · 0 direct, 4 classhop 77read: 7 admitted, 7 not

Lee Sharks · Crimson Hexagonal Archive · register v1.36, 2026-10-27. Built by scripts/build_non.py from the files linked above; it writes nothing back. Working, not frozen.