Skip to content

Implement FASE application data ingestion pipeline to Lakehouse #340

@bashanlam

Description

@bashanlam

Overview
The operational data for the FASE application is stored across both PostgreSQL and Oracle databases. We are leveraging the dlt (Data Load Tool) package to manage these data sources and execute the extractions within our ingestion pipelines.
This issue tracks the creation of the ingestion pipeline to move FASE application data into the lakehouse.

Tasks

  • Extract Oracle database source
  • Extract PostgreSQL database source
  • Load data into the Iceberg destination
  • Adapt pipeline source to the elt-common framework #321

Metadata

Metadata

Assignees

Labels

No labels
No labels
No fields configured for Feature.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions