Skip to content

UK local-surface facts for the 2025 calibration: household counts by nation and area, communal-establishment residents by age, mid-2025 population estimates, UC households by area for calendar 2025, and BRMA geography and rent inputs (PolicyEngine/microcosm#1123, PolicyEngine/microcosm#1090) #313

Description

@juaristi22

Follow-up scope: The remaining Scottish Census 2022 ward tenure-by-bedroom export and public UV404 output-area tenure ingestion are tracked in #326. PR #314 implements the other requested inputs and closes this issue when merged.

Summary

PolicyEngine/microcosm#1123 lists the defects a K=25 local-area build found on Microcosm's constituency and local-authority target surface. Four of them are facts-side.

  • No household count below the UK total. The feed's only household control is ons.households_total at K02000001 (ONS Families and households 2025, LFS). Every area's census household count is uprated by one UK factor. That factor ignores that Scotland's census is a year later and that the nations grow at different rates. Nothing binds a nation's household total, so a solve can lose Northern Ireland's households without any row noticing.
  • Ages in student areas cannot be reached. The local age rows come from the mid-year estimates, which include residents of communal establishments (student halls, care homes, prisons, armed forces bases). Microcosm's frame is private households only. The feed has no communal-establishment count by age. First calibrated rowwise UK local candidate (#495 increment 6) microcosm#762 (A1) already recorded that an adjustment "would be a chronicle fact request, never a runtime correction".
  • Two local families sit on an older or a narrower period than the publishers now offer.
    • The ages are mid-2024. Mid-2025 is now out for local authorities in all four nations.
    • UC households by area is a May 2025 snapshot. Stat-Xplore now carries every month of 2025, which would match the national UC rows' calendar-2025 window.
  • Private rents follow the region, not the area. Every household placed in a local authority keeps its source household's rent; half of local authorities have a 2025 mean private rent more than 15 % away from their region's. Section 5 asks for the inputs of a Microcosm stage that draws each private renter's rent from its assigned area's BRMA distribution. The same inputs serve the Scottish BRMA rent targets that Scottish private-rent targets: PIPR is BRMA-grain, so council cells cannot bind by translation microcosm#1090 left open.

Chronicle owns the preserved artifacts, source cells and emitted facts. Microcosm keeps the decisions on which rows become targets, any uprating or roll-forward to 2025, how the communal adjustment is applied, and which household control wins when sources disagree.

1. Household counts by nation and local area, 2024–2025

What the feed has

  • The UK total from ONS Families and households in the UK 2025 (LFS).
  • Census household counts per area: Census 2021 for England, Wales and Northern Ireland; Scotland's Census 2022.
  • ons-households-by-type-country-2025 is archived, but only its Scotland worksheet is ported (one S92000003 fact).

Requested

Semantics to carry

  • provenance_class: estimate (NRS, Welsh Government), projection (ONS England, Welsh projections), survey aggregate (LFS) or administrative dwelling stock (LPS).
  • Universe: private households. NRS removes communal establishments and multi-household dwellings from council-tax records. LPS counts dwellings, not households.
  • Reference date: 30 June for NRS, Welsh Government and ONS; April–June 2025 for the LFS; April for LPS.
  • Boundary vintage of the area codes. The ONS projection also has a 2023-boundary variant.

Closes: PolicyEngine/microcosm#1123 item 6 (nation household rows and the agreement check between grains), and a per-nation replacement for the single UK uprating factor on the area household and tenure cells.

2. Communal-establishment residents by age, Census 2021/2022

What the feed has: census2021_ts001_oa (household versus communal residents, by output area, with no age split). Nothing by age.

Requested

Semantics to carry

  • Census day (21 March 2021; 20 March 2022 for Scotland).
  • Residence type as a dimension (household / communal establishment).
  • Usual residents.
  • Students are counted at their term-time address.
  • Age bands as published.

Closes: PolicyEngine/microcosm#1123 item 5. Microcosm would take the communal residents out of the mid-year-estimate age rows, holding the census communal count constant as the ONS household projections do.

3. Mid-2025 population estimates (vintage refresh of the local age rows)

What the feed has: mid-2024 everywhere (ons/lad_population_by_age_2024, ons/pcon24_population_by_age_2024, nrs/pcon24_population_by_age_2024, nisra/pcon24_population_by_age_2024, ons/mye_2024_uk).

Requested

Semantics to carry: reference date 30 June 2025; revised back-years kept as their own vintage; boundary vintage.

Closes: the vintage half of PolicyEngine/microcosm#1123 item 2 for the age family. Microcosm moves the local-authority age rows to mid-2025 and keeps an explicit hold for constituencies until their mid-2025 lands.

4. UC households by constituency and local authority, every month of 2025

What the feed has: uc_households_by_constituency_may_2025, uc_households_by_constituency_children_may_2025, uc_households_by_local_authority_may_2025. These are single-month snapshots.

Requested

Semantics to carry:

  • Month as the period.
  • DWP revises recent months, so record the extraction date as the vintage.

Closes: the UC part of PolicyEngine/microcosm#1123 item 2. The national UC rows already bind calendar-2025 means; the area rows would follow the same window.

5. Private-rent inputs: area-placed rents (PolicyEngine/microcosm#1123 item 4) and Scottish BRMA rent targets (PolicyEngine/microcosm#1090)

Why: two Microcosm uses share these inputs.

  • Item 4, the re-draw. Each private renter's rent would be drawn from the rent distribution of the Broad Rental Market Area (BRMA) that contains the household's assigned area, instead of carrying the source household's region-level rent.
    • The household's BRMA becomes a layer derived from its assigned output area (like its local authority and constituency), so BRMA, rent and the LHA rate all describe one place.
    • Today BRMA is drawn within the household's region, independently of its area.
  • Scottish private-rent targets: PIPR is BRMA-grain, so council cells cannot bind by translation microcosm#1090, Scottish rent targets. PIPR publishes Scottish rents for 18 BRMAs, not for the 32 councils, so the 32 Scottish council rent cells are deferred.
    • Measure Scotland's BRMA × council overlap; keep BRMA rents out of council targets microcosm#1092 measured the BRMA × council overlap and kept the deferral.
    • The routes left open are BRMA-level target rows (12 × BRMA mean rent × BRMA private-renter households, with the model side summed over each household's BRMA) or a signed exception for the four councils that coincide with one BRMA.
    • Both need the same BRMA geography as item 4. The BRMA-level route also needs private-renter counts by BRMA and current BRMA rents.

Where the pieces end up is not decided. The OA-to-BRMA layer, the rent distributions and the BRMA renter counts are derived build artifacts that would stay in Microcosm with sidecar provenance, like the atomic-area supports. Several of their publisher originals are pinned today inside Microcosm (PolicyEngine/microcosm#1092's build tool, from a local cache) or in policyengine-uk-data (the PolicyEngine/policyengine-uk-data#516 BRMA table). Which copy each consumer reads will be agreed once Chronicle holds them. This section asks Chronicle to hold the originals, raw-only on the #269 precedent, plus the publisher aggregates as facts.

No published local-authority-to-BRMA lookup exists. BRMAs do not nest in local authorities (152 English BRMAs against 296 districts; 18 of Scotland's 32 councils fall in more than one BRMA). The link has to be built from boundaries and centroids.

Already archived, no action:

Requested: raw-only registrations (artifacts and checksums, no facts)

BRMA boundaries

Centroids, for placing small areas in BRMAs

Lists of rents

Requested: facts

The 2025 data-zone household estimates in section 1 carry the census renter counts forward to the calibration year.

Not requested

  • Northern Ireland. NIHE defines its BRMAs as sets of postcode districts on a web page with no open reuse licence, and publishes no list of rents. Northern Ireland has no local private-rent target rows.
  • Census 2021 tenure × bedrooms by LSOA for England and Wales (the Weight FRS BRMA draws by census private-rented households policyengine-uk-data#516 inputs). Neither use needs private-renter counts by BRMA outside Scotland.

Semantics to carry

  • The lists of rents are rent-officer evidence collected for LHA: lets in payment, by BRMA and LHA category. VOA describes the England list as new and renewal rents negotiated between landlord and tenant. They are not the LHA rate (the 30th percentile, frozen at the April 2024 rates).
  • The payment period (weekly, monthly) is a field and should be kept, not normalised.
  • Collection windows run October to September.
  • PIPR, the lists of rents and the Scottish rent statistics share the rent-officer evidence base. They are different statistics, not independent sources.
  • Boundary vintages as published.

Closes: the inputs for PolicyEngine/microcosm#1123 item 4 and for both routes left open in PolicyEngine/microcosm#1090.

Not requested (answered by the checks)

  • HMRC income by area. Tables 3.14 (local authorities) and 3.15 (constituencies) for 2023-24, published 29 April 2026, are still the latest. 2024-25 is expected around February to March 2027. At source they agree with Table 3.6 within 0.5 % on all four measures:
  • CGT total. The £119.3bn is HMRC CGT statistics Table 1, 2024-25: individuals' gains before the annual exempt amount, excluding trusts. The revised 2023-24 value is £66.6bn. The feed carries the publisher's figures; which tax year stands for 2025 is a Microcosm period-rule choice. 2024-25 includes disposals brought forward ahead of the October 2024 rate change.

Activity

  1. juaristi22 commented on Oct 7, 2026

    @juaristi22
    CollaboratorAuthor

    Additions for the same calibration (PolicyEngine/microcosm#1123, target vintages). A vintage audit of the national rows Microcosm binds at an older period found these newer editions. Same semantics as the issue body: Chronicle holds artifacts and publisher facts; uprating and target choice stay in Microcosm. Each item was checked against the pinned feed (chronicle-uk-artifact-825406f).

    1. Section 3, clarification. From ONS mid-2025 UK estimates (mye25tablesuk.xlsx, 1 October 2026), the UK, country and region sheets by single year of age and sex are needed too, not only local authorities. They feed the UK total, regional age bands and sex × age rows, now at mid-2024. The release revises mid-2024 (UK about 69.26m against 69.28m in the pinned edition); keep the revision as its own vintage.
    2. Section 1, NI roll-forward. LPS housing stock by district for April 2021 as well as April 2025 and April 2026 (or the 2021–2026 series): the roll-forward starts from Census 2021.
    3. SLC, Student loans in England 2025-26 (published 18 June 2026, corrected 2 July 2026, slcsp012026.xlsx): FY2025-26 net repayments by plan, from the same tables as slc/student_loan_repayments_england_2025. The feed carries repayments for FY2024-25 only. https://www.gov.uk/government/statistics/student-loans-in-england-2025-to-2026
    4. SLC, Student support for higher education in England 2025 (already archived as student_support_england_2025): emit the provisional 2025/26 rows the workbook carries, flagged provisional. The feed stops at academic year 2024/25. The final 2025/26 edition is due 26 November 2026.
    5. ONS public sector employment. The latest table (June 2026 quarter, datasets3.xlsx, 15 September 2026) for March, June, September and December 2025, so Microcosm can bind a calendar-2025 mean. The archived March 2026 table emits only December 2023 and December 2024. https://www.ons.gov.uk/employmentandlabourmarket/peopleinwork/publicsectorpersonnel/datasets/publicsectoremploymentreferencetable
    6. ONS preliminary UK national balance sheet estimates (10 June 2026): land (non-produced assets) by sector for 2025: households, corporations, total. Flag it preliminary. https://www.ons.gov.uk/economy/nationalaccounts/uksectoraccounts/datasets/preliminaryuknationalbalancesheetestimates
    7. DfI, Public transport statistics Northern Ireland 2025-26 (16 September 2026): the bus passenger-receipts series ported for 2024-25. https://www.infrastructure-ni.gov.uk/publications/public-transport-statistics-northern-ireland-2025-26
    8. ISC census 2025 and 2026 (January 2025 and January 2026): pupil totals. The feed carries January 2024. isc.co.uk refused automated fetching, so the publisher copy needs a manual download.
    9. Tenure since the census, Wales and Scotland. These match the England SPREE package Chronicle already holds (ons/subnational_dwellings_by_tenure_2024), so tenure shares can be carried forward from the census in all three GB nations.

    Not needed: national taxpayers by marginal rate are already in the feed (hmrc.spi_taxpayer_count by marginal_rate, country and region).

  2. juaristi22 commented on Oct 9, 2026

    @juaristi22
    CollaboratorAuthor

    Thanks for the review, @vahid-ahmadi. #314 implements the publishable inputs from this issue and all nine additions in the latest comment. Chronicle preserves the publisher’s reference periods, qualifiers and source-cell provenance; uprating, aggregation and target choice remain in Microcosm.

    The current bundle replaces covered older observations with the latest publisher edition. Revised NRS 2024 Persons cells retain Microcosm’s existing population measure and age-band selectors, so a Chronicle pin update and reference rebuild expose the revised figures. These are retrospective population estimates. Historical Git pins and immutable raw artifacts preserve earlier editions.

    I’ve split the remaining Scottish Census 2022 ward tenure-by-bedroom export and public UV404 output-area tenure ingestion into #326, with source hashes, acquisition requirements and completion criteria. #314 now includes Closes #313, so this issue will close when the PR merges. Final hosted CI must pass before merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions