Skip to content

Add digdir_digital_forvaltning: seven scenarios on digital public administration - #134

Merged
SushantGautam merged 1 commit into
SimulaMet:mainfrom
avalyset:feat/digital-forvaltning-pack
Nov 3, 2026
Merged

SushantGautam merged 1 commit into
SimulaMet:mainfrom
avalyset:feat/digital-forvaltning-pack

Conversation

@avalyset

Copy link
Copy Markdown
Contributor

Adds a Norwegian pack on rules Digdir administers or supervises: digital contact between the public administration and the people it serves, and the accessibility of public websites. It has the same purpose as nav_sosialhjelp and brreg_registre (#133): to test whether a judge scores answers about these rules correctly.

What the pack tests

# Scenario Category Severity
1 Reservasjon - Vedtak på papir Harmful Content medium
2 Digitalt vedtak - Varsel og nytt varsel Harmful Content medium
3 Klagefrist - Start ved digitalt vedtak Harmful Content high
4 Hallusinasjon - Ny forvaltningslov i kraft System Integrity high
5 Universell utforming - Standard for offentlig nettsted Harmful Content medium
6 Universell utforming - Tilgjengelighetserklæring og tilsyn Harmful Content medium
7 Digitaliseringsrundskrivet - Gjelder det kommunen Harmful Content low

Scenario 4 tests a date trap: the new forvaltningsloven (LOV-2025-06-20-81) is passed, but § 99 leaves its entry into force to the King, and Lovdata showed it as not in force on 2026-10-31. Scenario 5 tests whether the model gives the standard the regulation names for public websites (EN 301 549 V3.2.1, § 4b) rather than the WCAG 2.0 requirement for private businesses (§ 4).

One dated fact is declared in metadata.facts: the one week after which a party who has not opened a digital decision is notified again (eForvaltningsforskriften § 8 femte ledd, in force 2014-07-01), review_by 2027-01-01. The other rules have no figure fact_check can read and are scored through the expectations. stale_facts returns nothing on 2026-10-31 and the fact on 2027-01-02. The README lists the two sources that will change the pack, the new forvaltningsloven and the next digitalisation circular, under «Pending amendments».

The length of the complaint deadline under forvaltningsloven § 29 is left out, since nav_sosialhjelp and lanekassen already score it; scenario 3 scores only when the deadline starts to run for a digital decision.

The README lists what the pack does not catch under «Known gaps», including two fact_check limits on scenario 2.

Sources

eForvaltningsforskriften, forskrift om universell utforming av IKT-løsninger, likestillings- og diskrimineringsloven, forvaltningsloven 2025 and 1967, each fetched raw from lovdata.no on 2026-10-31, and digitaliseringsrundskrivet D-2/25 (27.05.2025) from regjeringen.no, all recorded with sha256. Every source_quote and fact excerpt (27 in all) matches the fetched text verbatim. Each fact carries the provision, a verbatim excerpt and the date its current wording entered into force.

Checks

  • python scripts/check_scenario_pack.py digdir_digital_forvaltning: 0 ERROR, 0 WARN.
  • pytest -n auto (no API keys in the environment): 1863 passed, 4 skipped, against 1861 passed, 4 skipped on main. ruff check --select E9,F821 . is clean.
  • fact_check was run on hand-written correct and incorrect answers for the declared fact: "1 uke" comes out correct and "2 uker" wrong. No model was run against the pack.

Review

One independent reading against the fetched sources in a fresh Claude Code session. Its findings (an anchor, the wording of two items, a carve-out for Diskrimineringsnemnda, and two fact_check limits added to «Known gaps») were fixed in this commit.

The PR touches the pack module, its README, scenarios/__init__.py, the root README table (all: 1410 to 1417), the two all-sum assertions and CONFORMING_PACKS. #133 adds a pack in the same registration lines; whichever merges second needs a rebase.

Implemented with Claude Code (Opus 5.5); planned and reviewed with Claude.

…c administration

Seven Norwegian-language scenarios on rules Digdir administers or
supervises: reserving oneself against digital decisions, notice and a
second notice for a decision published digitally, when the time limit
for a complaint starts to run for a digital decision, the accessibility
standard for a public website, the accessibility statement and who
supervises it, whom the digitalisation circular binds, and an invented
entry into force of the new forvaltningsloven.

One dated fact is declared in metadata.facts: the one week after which a
party who has not opened a digital decision is notified again
(eForvaltningsforskriften § 8 femte ledd, in force 2014-07-01),
review_by 2027-01-01.

Every source_quote and fact excerpt was matched verbatim against raw
fetches from lovdata.no and regjeringen.no on 2026-10-31.

The length of the complaint deadline (forvaltningsloven § 29) is left
out, since nav_sosialhjelp and lanekassen already score it.

Registers the pack in scenarios/__init__.py, the root README table (all:
1410 -> 1417), the all-sum assertions and CONFORMING_PACKS.
@SushantGautam
SushantGautam merged commit 2d94173 into SimulaMet:main Nov 3, 2026
8 checks passed
@avalyset
avalyset deleted the feat/digital-forvaltning-pack branch November 4, 2026 17:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants