Add Loom memory-service integration for LongMemEval#2

Open

zlareb1 wants to merge 12 commits into

mainfrom

add-loom-integration

Commits on Jun 5, 2026

Add Loom memory-service integration for LongMemEval

zlareb1
and
claude
committed
loom: add --shuffle/--seed for stratified sampling under --limit

zlareb1
and
claude
committed
loom: add --question-type filter to run_loom.py for per-category diagnostics

zlareb1
and
claude
committed

Commits on Jun 18, 2026

evaluate_qa: report under a fair field-consensus semantic judge

zlareb1
and
claude
committed
loom bench: semantic QA judge + fact-level recall, richer reader context

zlareb1
and
claude
committed

Commits on Jun 22, 2026

Commits on Jun 23, 2026

docs(loom): honest LLM-free full-500 latency + accuracy

zlareb1
and
claude
committed