AXN:0BBA.CAPTURE
AXN:0BBA.CAPTURE is the position of the Capture Registry address for the query “The Pile dataset”. Each observation at the address (one surface, one date) is one AXN, its glyphs derived from the SHA-256 of the observation sealed with its analysis and measures.
- Query
- The Pile dataset
- Identifies
- the capture record of the Capture Registry
- Hex position
0BBA
- Family
CAPTURE
- Ledger
- /data/captures/axn.json
AXN:0BBA.CAPTURE.⏩🕙🏛️🧡🔅🪐
- Observation
- Google AI Overview, 2026-11-01 · the capture
- Description
- THE DATASET, SIGNED OUT, 2026-11-01: 'The Pile is an 825 GiB to 886 GB open-source English text dataset created by EleutherAI and released on December 31, 2020, to train large language models (LLMs).' Key overview (size, '~825 GiB compressed (zstandard format) containing roughly 300 billion tokens'; composition; purpose; 'Notable Models Trained On It: GPT-Neo, GPT-J, and the Pythia suite by EleutherAI'); the 22 sub-datasets, numbered, 'Books3 (Long-form literary text/books)' third and 'Gutenberg (PG-19) (Public domain literature)' eleventh; controversies and evolution ('resulting in content adjustments'; Common Pile v0.1). Eight cards: the Pile's home page, Wikipedia, Hugging Face, Reddit r/MachineLearning, the Pile's paper page, a YouTube paper reading, Hugging Face on the Common Pile v0.1, Michael Brenndoerfer.
- Reading
- The innocent reading first. Asked for the dataset, the Overview gives its maker, date, size, purpose and the models trained on it, lists its twenty-two components with a gloss on each, and closes on its copyright disputes and its licensed successor.
- Analysis
- The dataset composed at its grain and itemized to its twenty-two components, the training layer named as the census row names it. Its literary component is glossed by genre, and the pirated source, the removal and the authors' suit that put works in it under their authors' names are reduced to 'content adjustments'.
- Match
- BROAD MATCH — 'THE PILE DATASET' ON THE OVERVIEW — THE DATASET ITEMIZED, ALL TWENTY-TWO COMPONENTS; BOOKS3 AS 'LONG-FORM LITERARY TEXT', ITS PIRATED SOURCE, ITS REMOVAL AND THE AUTHORS' SUIT GIVEN AS 'CONTENT ADJUSTMENTS'
- PER
- 0.25 — EleutherAI named in the body; Leo Gao and Stella Biderman on the Hugging Face card; the home page, paper page and Wikipedia carded.
- Citations
- 8 (0 archive-controlled)
- Sealed observation
- /data/captures/sealed/the-pile-dataset-aio-20261101.json — SHA-256
d66b20ceed0d255088c5144e296c1cedc99fb7eda3ed5b83677bc242b30b02b3
Resolver rule: alexanarch.org/axn/<HEX> ·
term set: AXN identifier set ·
machine index: /api/axn-index.json