Scaffold the Claude Code and Codex paper catalog

.github/ISSUE_TEMPLATE/config.yml

@@ -0,0 +1 @@
+blank_issues_enabled: true

.github/ISSUE_TEMPLATE/paper.yml

@@ -0,0 +1,61 @@
+name: Suggest a paper
+description: Suggest a paper that evaluates, analyzes, or improves a production coding agent.
+title: "[Paper]: "
+labels: [paper-candidate]
+body:
+  - type: input
+    id: title
+    attributes:
+      label: Paper title
+    validations:
+      required: true
+  - type: input
+    id: paper_url
+    attributes:
+      label: Primary-source URL
+      description: Official proceedings, DOI, OpenReview, or arXiv URL.
+    validations:
+      required: true
+  - type: dropdown
+    id: products
+    attributes:
+      label: Products studied
+      multiple: true
+      options:
+        - Claude Code
+        - Codex CLI
+        - Historical OpenAI Codex model
+    validations:
+      required: true
+  - type: dropdown
+    id: classification
+    attributes:
+      label: Suggested evidence class
+      options:
+        - Direct comparison
+        - Related method
+        - Evaluation only
+        - Historical model
+    validations:
+      required: true
+  - type: textarea
+    id: evidence
+    attributes:
+      label: Baseline and result evidence
+      description: Quote table or section numbers and paraphrase the result. Include model and budget details when available.
+    validations:
+      required: true
+  - type: input
+    id: artifact_url
+    attributes:
+      label: Artifact URL
+      description: Optional official code, data, or reproduction repository.
+  - type: checkboxes
+    id: checks
+    attributes:
+      label: Submission checks
+      options:
+        - label: I linked a primary research source rather than a blog summary.
+          required: true
+        - label: The paper studies the product agent, not only a model from the same vendor.
+          required: true

.github/pull_request_template.md

@@ -0,0 +1,15 @@
+## Summary
+
+Describe the paper additions or catalog corrections.
+
+## Evidence
+
+Link primary sources and identify the tables, sections, or appendices supporting quantitative claims.
+
+## Checklist
+
+- [ ] Inclusion criteria are satisfied.
+- [ ] Product, model, version, and budget fields are complete or explicitly unknown.
+- [ ] Comparability caveats are recorded.
+- [ ] `make check` passes.
+- [ ] No paper PDF has been committed.

.github/workflows/validate.yml

@@ -0,0 +1,24 @@
+name: Validate catalog
+
+on:
+  pull_request:
+  push:
+    branches: [main]
+  workflow_dispatch:
+
+permissions:
+  contents: read
+
+jobs:
+  validate:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+      - uses: actions/setup-python@v5
+        with:
+          python-version: "3.12"
+          cache: pip
+      - name: Install dependencies
+        run: python -m pip install -r requirements-dev.txt
+      - name: Validate catalog and generated files
+        run: make check

.gitignore

@@ -0,0 +1,6 @@
+.venv/
+__pycache__/
+.pytest_cache/
+.ruff_cache/
+*.pyc
+.DS_Store

CONTRIBUTING.md

@@ -0,0 +1,63 @@
+# Contributing
+
+Thank you for helping maintain an accurate, evidence-first catalog of research on production coding agents.
+
+## Inclusion criteria
+
+A paper belongs in the catalog when at least one of the following is true:
+
+1. It directly executes Claude Code or Codex CLI in an experiment.
+2. It proposes a method that wraps, configures, improves, or competes with one of those products.
+3. It introduces a benchmark or empirical study with product-level Claude Code or Codex CLI results.
+4. It studies the historical OpenAI Codex model and is clearly labeled `historical`.
+
+A paper does not belong in the primary catalog merely because it uses a Claude or GPT-family model. The product agent or harness must be part of the study.
+
+## Evidence standard
+
+Every entry must link to a primary source: the official proceedings page, DOI landing page, OpenReview record, arXiv record, or authors' artifact repository.
+
+Reported results must be paraphrased accurately and accompanied by comparison caveats. Do not infer that a comparison is same-model or same-budget unless the paper explicitly establishes it.
+
+Use these values when the paper is unclear:
+
+```yaml
+same_model: unknown
+same_budget: unknown
+```
+
+## Adding a paper
+
+1. Add one entry to `data/papers.yaml`.
+2. Use a stable identifier such as `short-title-year`.
+3. Choose the narrowest correct evidence class.
+4. Run `make build` to regenerate README tables.
+5. Run `make check` before opening a pull request.
+
+Do not manually edit content between `CATALOG:*:START` and `CATALOG:*:END` markers in `README.md`; those sections are generated.
+
+## Evidence classes
+
+- `direct`: a numeric head-to-head comparison with Claude Code or Codex CLI.
+- `related`: relevant product-level evidence, but not a clean numeric head-to-head.
+- `evaluation`: product evaluation without a proposed improvement method.
+- `historical`: pre-CLI OpenAI Codex model research.
+
+## Product naming
+
+Use canonical identifiers:
+
+- `claude-code`
+- `codex-cli`
+- `openai-codex-model` for historical model-only work
+
+Future products must be added to both `data/schema.json` and `docs/taxonomy.md` before use.
+
+## Pull request checklist
+
+- [ ] The paper satisfies the inclusion criteria.
+- [ ] All quantitative claims match the cited primary source.
+- [ ] Model, version, budget, and tool details are recorded or marked unknown.
+- [ ] Comparison caveats are explicit.
+- [ ] `make check` passes.
+- [ ] No copyrighted PDF has been committed.

LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 MicroMilo
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

Makefile

@@ -0,0 +1,21 @@
+.PHONY: install build validate test lint check
+
+install:
+	python -m pip install -r requirements-dev.txt
+
+build:
+	python scripts/build_readme.py
+
+validate:
+	python scripts/validate.py
+
+test:
+	python -m pytest
+
+lint:
+	python -m ruff check scripts tests
+
+check: validate
+	python scripts/build_readme.py --check
+	python -m pytest
+	python -m ruff check scripts tests