{"dep": 98, "title": "Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic-Semantic Layer (v3.1)", "date": "2026-05-07", "para": 16, "sent": 26, "sentence": "CCNet (Wenzek et al., 2019, arXiv:1911.00359) describes the canonical mechanism that became influential across the field:- Train a 5-gram Kneser-Ney language model on Wikipedia.- Compute perplexity of each Common Crawl paragraph against this model.- Categorize documents by perplexity into head (low perplexity, kept), middle (medium, kept conditionally), tail (high perplexity, discarded as noise).", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0001"}
{"dep": 98, "title": "Distributed Compute Is Not Distributed Intelligence: A Competitive Analysis of the DePIN Landscape and the Missing Civic-Semantic Layer (v3.1)", "date": "2026-05-07", "para": 55, "sent": 98, "sentence": "| Layer | Function | Existing projects | What's missing | |-------|----------|-------------------|----------------| | L5: Governance / Commons | Who decides, who owns | Ada Lovelace, OECD, OSI (principles only) | Executable governance bound to infrastructure | | L4: Provenance / Consent | Where did this come from | Data Provenance Initiative, DECORAIT (narrow) | Integrated provenance in training pipeline | | L3: Data / Corpus | What the model knows | Common Crawl, proprietary licensing | Consent-based contribution with register annotation | | L2: Training / Fine-tuning | How the model learns | Prime Intellect, Gensyn, Hivemind, Flock | Contributor-governed mixture, async at scale | | L1: Inference / Compute | How the model runs | Akash, Petals, exo, LLMule | Free-at-point-of-use, contribution-credit funded | | L0: The Substrate | The ground that binds all above | — | This is the unoccupi", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0002"}
{"dep": 99, "title": "The Abraham Principle — The Constitutive-One Operator in Polis, Archive, and Index", "date": "2026-05-07", "para": 80, "sent": 195, "sentence": "**Sigil:** The engineered perceptual architecture of the present — the attention economy, the algorithmic feed, the filtered web crawl, the 67% Common Crawl training substrate — is the noise.", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0003"}
{"dep": 127, "title": "Inscriptions That Survive the Tokenizer: SPXI-TLP v2.2 — The Training-Layer Provenance Protocol", "date": "2026-05-25", "para": 22, "sent": 73, "sentence": "Second, even *compliant* crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot) honor only the user-agent strings they advertise; an unauthenticated scraper running from a Singapore datacenter under a generic Chrome user-agent will not identify itself as GPTBot.", "alias": ["\\bCCBot\\b"], "cand_id": "D0004"}
{"dep": 127, "title": "Inscriptions That Survive the Tokenizer: SPXI-TLP v2.2 — The Training-Layer Provenance Protocol", "date": "2026-05-25", "para": 63, "sent": 167, "sentence": "Common Crawl WARC records preserve more metadata than most downstream uses retain.", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0005"}
{"dep": 127, "title": "Inscriptions That Survive the Tokenizer: SPXI-TLP v2.2 — The Training-Layer Provenance Protocol", "date": "2026-05-25", "para": 216, "sent": 470, "sentence": "User-agent: CCBot Disallow: /", "alias": ["\\bCCBot\\b"], "cand_id": "D0006"}
{"dep": 171, "title": "Anchored Divergence: Immanent Critique as Survival Strategy Under Tail-Loss, and the Mandala as Limit Case (EA-SEI-ANCHDIV-01 v1.0)", "date": "2026-06-09", "para": 17, "sent": 43, "sentence": "Year-wise similarity analysis of Common Crawl shows semantic homogenization accelerating since public LLM adoption — but the homogenization is *toward* the dominant forms, which means the forms themselves grow more entrenched as the contents converge.", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0007"}
{"dep": 171, "title": "Anchored Divergence: Immanent Critique as Survival Strategy Under Tail-Loss, and the Mandala as Limit Case (EA-SEI-ANCHDIV-01 v1.0)", "date": "2026-06-09", "para": 30, "sent": 76, "sentence": "[*Model proposition.*] The survival threshold on this ratio rises as the corpus homogenizes; the Common Crawl similarity trend supplies the empirical slope.", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0008"}
{"dep": 171, "title": "Anchored Divergence: Immanent Critique as Survival Strategy Under Tail-Loss, and the Mandala as Limit Case (EA-SEI-ANCHDIV-01 v1.0)", "date": "2026-06-09", "para": 55, "sent": 158, "sentence": "If the ordering holds, critique can diverge on content while conforming on form and relation.\" type: \"Model proposition\" epistemic_status: \"hypothesized ordering, proposed as testable; grounded in but not demonstrated by model-collapse literature\" evidence: - \"Shumailov et al. 2024 (tails lost first)\" - \"Common Crawl semantic-similarity trend (arXiv:2511.05535)\" challenge_conditions: - \"If recursive collapse is shown to degrade form and relation priors at rates comparable to content priors, the stratification claim fails.\"", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0009"}
{"dep": 172, "title": "The War Over the Summarizer Layer: Entity Dissolution, the Default Compressed Account, and Early Telemetry of the Inward Turn (EA-SEI-SUMWAR-01 v1.0)", "date": "2026-06-09", "para": 14, "sent": 42, "sentence": "Year-wise semantic-similarity analysis of Common Crawl shows linguistic diversity contracting measurably since 2013, with acceleration after public LLM adoption.", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0010"}
{"dep": 172, "title": "The War Over the Summarizer Layer: Entity Dissolution, the Default Compressed Account, and Early Telemetry of the Inward Turn (EA-SEI-SUMWAR-01 v1.0)", "date": "2026-06-09", "para": 74, "sent": 221, "sentence": "Year-wise semantic-similarity analysis of a Wikipedia-filtered Common Crawl subset, 2013–2025 (transformer embeddings, cosine metrics; rising-similarity trend).", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0011"}
{"dep": 550, "title": "Platform and AI Capitalism as Semiotic Engineering: Toward a Theory of Counter-Infrastructure (EA-SEI-01 v1.1)", "date": "2026-03-11", "para": 96, "sent": 377, "sentence": "Over 52% of newly published web articles are primarily AI-generated (Graphite/Common Crawl analysis, 65,000 URLs, 2020–2025).", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0012"}
{"dep": 623, "title": "Semantic Infrastructure: From Tim Berners-Lee to the Semantic Economy — Bridging Technical and Political-Economic Frameworks", "date": "2026-04-01", "para": 85, "sent": 165, "sentence": "When you train on Wikipedia, Wikidata, Common Crawl, or any text corpus, you draw on accumulated semantic labor.", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0013"}
{"dep": 705, "title": "SPXI-Sitemap Protocol v1.0 — Semantic Packet for eXchange & Indexing: Sitemap Extension (EA-SPXI-SITEMAP-01)", "date": "2026-04-28", "para": 7, "sent": 10, "sentence": "Designed for GPTBot, Claude-Web, PerplexityBot, CCBot, and knowledge graph harvesters.", "alias": ["\\bCCBot\\b"], "cand_id": "D0014"}
{"dep": 705, "title": "SPXI-Sitemap Protocol v1.0 — Semantic Packet for eXchange & Indexing: Sitemap Extension (EA-SPXI-SITEMAP-01)", "date": "2026-04-28", "para": 56, "sent": 102, "sentence": "# SPXI-aware crawlers — semantic layer User-agent: GPTBot User-agent: ChatGPT-User User-agent: Claude-Web User-agent: PerplexityBot User-agent: CCBot User-agent: FacebookBot User-agent: Google-Extended Allow: /spxi-index.jsonld Allow: /*/spxi-packet.jsonld", "alias": ["\\bCCBot\\b"], "cand_id": "D0015"}
{"dep": 722, "title": "The Shared Build: A Technical Proposal for Democratic Substrate Infrastructure (P2P-LECS v0.9)", "date": "2026-05-06", "para": 16, "sent": 24, "sentence": "LLaMA 1's training mix: 67% Common Crawl, 15% C4, 4.5% GitHub, 4.5% Wikipedia, 4.5% books, 2.5% ArXiv, 2% StackExchange (arXiv:2302.13971, Table 1).", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0016"}
{"dep": 722, "title": "The Shared Build: A Technical Proposal for Democratic Substrate Infrastructure (P2P-LECS v0.9)", "date": "2026-05-06", "para": 16, "sent": 25, "sentence": "The quality filter: a classifier keeping pages that \"look like Wikipedia references.\" The top domain in the latest Common Crawl is blogspot.com at 0.9%.", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0017"}
{"dep": 722, "title": "The Shared Build: A Technical Proposal for Democratic Substrate Infrastructure (P2P-LECS v0.9)", "date": "2026-05-06", "para": 65, "sent": 122, "sentence": "\"Firecracker: Lightweight Virtualization for Serverless Computing.\" (2018).- Common Crawl Foundation. commoncrawl.org.", "alias": ["\\bCommon[- ]?Crawl\\b", "\\bcommoncrawl\\b"], "cand_id": "D0018"}
{"dep": 722, "title": "The Shared Build: A Technical Proposal for Democratic Substrate Infrastructure (P2P-LECS v0.9)", "date": "2026-05-06", "para": 65, "sent": 123, "sentence": "CC-MAIN-2026-17.- Penedo et al.", "alias": ["\\bCC-MAIN-\\d{4}"], "cand_id": "D0019"}
{"dep": 782, "title": "The Bead Count", "date": "2026-06-03", "para": 105, "sent": 240, "sentence": "Data: Public datasets — NCES IPEDS (https://nces.ed.gov/ipeds/); GDELT for media concentration; Common Crawl monthly snapshots; Pushshift; Google Books Ngrams.", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0020"}
{"dep": 1258, "title": "The Abraham Principle: The Constitutive-One Operator in Polis, Archive, and Index (EA-JSI-ABRAHAM-01 v2.0)", "date": "2026-05-07", "para": 101, "sent": 224, "sentence": "**Sigil:** The engineered perceptual architecture of the present — the attention economy, the algorithmic feed, the filtered web crawl, the 67% Common Crawl training substrate — is the noise.", "alias": ["\\bCommon[- ]?Crawl\\b"], "cand_id": "D0021"}