Skip to content

Spark Declarative Pipelines: enable primary key check as expectation #55998

@br-valstream

Description

@br-valstream

A core limitation of SDP in current state is the inability to directly apply check for uniqueness/PKs via expectations. The current documentation recommends the creation of an additional view to assert PK uniqueness (suboptimal for pipelines with many tables requiring PK checks).

Enabling PK checks out of the box would greatly improve the package.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions