data: monthly pipeline refresh 2026-08 - #48
Merged
Conversation
gabrielspadon
added a commit
that referenced
this pull request
Aug 21, 2026
## Monthly audit finding The August refresh converged mechanically, but its generated PR still contained semantic citation conflicts and unsafe merge decisions. This source-only change fixes the decision paths. No generated `.bib` file is edited. ## Source fixes - Keep rejected candidate DOIs out of disk deduplication. - Reprocess published DOI entries whose URL still points to a different preprint. - Remove unconfirmed Scholar container metadata after a validated arXiv DOI. - Treat Crossref proceedings volumes as books rather than papers. - Match abbreviated author initials without conflating different authors. - Force every author directory involved in a same-DOI conflict to re-enrich. - Reject finalization if material same-DOI conflicts remain anywhere in the corpus or the a2i2 aggregate. ## Audit evidence - Monthly run 32494455377 succeeded and converged in three passes. - Generated PR #48 has 503 BibTeX path changes and all structural CI green. - Semantic review found rejected-candidate DOI leakage, stale published metadata, a contaminated arXiv record, one proceedings volume misclassified as a paper, and unresolved same-DOI conflicts. - The deletion of Zero-Shot Out-of-Distribution Detection with Feature Correlations is retained because authoritative metadata identifies it as an unpublished 2019 record, outside the configured 2020 contribution window. ## Verification - `ruff check citeforge/ tests/ main.py` - `mypy citeforge/ main.py` - `pytest -m "not live"` - 2,074 passed, 2 skipped, 7 deselected - No `output/` changes
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Automated corpus refresh for 2026-08. Required CI checks code and structure. A monthly citation audit must verify the manifest, semantic data delta, and downstream website effect before merge.