Skip to content

test(pii): bench name columns for LooksPersonNameColumn (#163) - #201

Merged
DavidGodefroid merged 1 commit into
mainfrom
fix/163-pii-person-names
Nov 14, 2026
Merged

DavidGodefroid merged 1 commit into
mainfrom
fix/163-pii-person-names

Conversation

@DavidGodefroid

Copy link
Copy Markdown
Owner

Part of #163 (the lockkit half; #171 shipped LooksPersonNameColumn).

What

  • Detection bench (pii: a public detection bench (precision and recall per detector, CI baseline) #129): new pii/testdata/bench/namecolumns.jsonl, written by benchgen: 320 sampled name columns (80 per language, EN/FR/NL/DE). Positives: name/full_name/nom/naam/customer_name… columns in tables of people (customers, klanten, utilisateurs, mitglieder…) or neutral tables (orders, factures…) holding person names (gazetteer and synthetic, accented, titled, some blank or non-name values). Negatives: products.name ("Laptop Pro 14"), roles.name ("admin", "editor"), cities.name ("Namur", "Liège"), tags.name ("urgent"), categories, companies, and tables of people whose name column holds companies/logins only.
  • TestBench scores LooksPersonNameColumn per language (namecolumns/<lang>/precision|recall), held to baseline.json; RESULTS.md gets a "Name columns" table. TestBenchCorpusCoverage requires ≥ 30 columns per label and language.
  • Gap the bench found: German -er plurals (mitglieder) and staedte/städte were not read as table hints. Fixed in singulars/thingTables.

Results

Lang Precision Recall
en 1.000 0.975
fr 1.000 0.900
nl 1.000 0.925
de 1.000 0.950
all 1.000 0.938

Remaining misses: columns mostly of surname-first values ("Bauer, Stefan") or given names outside the gazetteer: not a whole-name match by design.

Tests

  • TestScoreColumns, extended TestTableHint; go test ./... green locally.

Not in this PR

docs: n/a (bench and test data only; the table-hint fix is internal to an existing heuristic, no documented behaviour changes).

🤖 Generated with Claude Code

Add sampled name columns to the detection bench (namecolumns.jsonl):
name/full_name/nom/naam columns with EN/FR/NL/DE person names, and
products/roles/cities/tags/companies negatives, scored for precision
and recall per language and held to the baseline.

Read German -er plurals (mitglieder) and staedte as table hints.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@DavidGodefroid
DavidGodefroid merged commit 11d7a9d into main Nov 14, 2026
4 checks passed
@DavidGodefroid
DavidGodefroid deleted the fix/163-pii-person-names branch November 14, 2026 11:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant