Skip to content

AI/ML CI trust: bare L1 jobs + pytest in L2 generated projects #92

Description

@ulises-jeremias

Problem

Scaffold-only CI can mask broken generated tests and skip templates that have no
extensions yet (lessons from Create-Node-App/cna-templates#189#193). AI/ML templates
and extensions must prove runtime trust, not only install/lint.

Solution

Extend the AI/ML CI plan (#76) with explicit trust requirements:

  1. Bare L1 jobs for every new AI/ML template type even when zero extensions exist yet
    (e.g. mlops-sklearn-starter alone).
  2. L2 must run pytest (or the template's test command) inside the generated project
    after scaffold — not only uv sync / ruff.
  3. Env validation: generated projects must not rely on skipping env schema checks;
    use .env.example / fixtures only. No network/API credentials in default CI.
  4. Document these bullets in docs/AI_ML_AUTHORING.md and in each AI/ML profile under
    ci/profiles/.

Parent

Part of #71. Implements trust requirements for #76. Pattern import from CNA #189#193.

Acceptance criteria

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions