Data Engineer based in Lahore | Open-Source Contributor
I build reliable data pipelines, from ingestion to analytics-ready datasets. Day to day, that means ETL/ELT in Python and SQL, large-scale processing on Apache Spark and Databricks, and dimensional modeling, with a focus on getting incremental ingestion right: CDC, Delta Lake MERGE, and clean dbt transformations. I also hunt the bugs that do not crash. They quietly return the wrong answer.
- Built the Jira source connector for Galaxy's Filament, which shipped in Filament v0.46.0 (November 2026); now building the Trello source connector (in review)
- Contributing to delta-rs (Delta Lake, Rust) and maintaining my open pull requests across the data stack
- Research: fault-injection benchmarking for data quality monitoring, and CDC strategies on Delta Lake under late-arriving updates
| Project | Merged | Pull requests | What I contributed |
|---|---|---|---|
| delta-io/delta-rs | 7 | #4832, #4833, #4866, #4890, #4942, #4966, #5004 | Correctness fixes: schema-merge nullability, pre-epoch timestamp statistics, TIMESTAMP UTC offset, validation error naming; docs on retention config, merge examples, and writer env vars |
| kedro-org/kedro | 3 | #5808, #5809, #5828 | CachedDataset docs example, templating concept page rewrite, OmegaConfigLoader resolver fix |
| apache/iceberg-python | 3 | #4135, #4142, #4144 | Timestamp parser and predicate evaluation fixes |
| apache/datafusion | 1 | #26489 | width_bucket bucket-computation dedup |
| bytewax/bytewax | 1 | #637 | Build info: __version__, __git_revision__, __git_dirty__ |
| galaxy-io/filament | 1 | #682 | Jira source connector: 9 resources, incremental reads on updated, shipped in v0.46.0 |
| open-metadata/docs-om | 2 | #599, #615 | OpenSearch FGAC permissions guide, dev container setup fix |
| ClickHouse/ClickHouse | 1 | #125739 | Version note for Replicated engine default_replica_path settings |
| sqlfluff/sqlfluff | 1 | #8715 | Removed outdated Snowflake USING note from Rule ST07 |
| airbytehq/airbyte | 1 | #88468 | Fixed dead low-code CDK sample connector links |
| canonical/starbase | 1 | #638 | llms.txt description from index.rst |
Also in review: Filament #705 (Trello source) and #716 (last_record pagination), iceberg-python #4383, trino-python-client #654, delta-rs #5012 and #5037, dbt #16690, Airflow #74424, and pull requests in Chroma, Apache Iceberg, lakeFS, and Canonical projects.
Previously validated the Databricks Zerobus sink for Galaxy's Filament, which shipped in Filament v0.24.0.
- Languages: Python, SQL, Rust, Go
- Data processing: Apache Spark, Databricks, Delta Lake, dbt, Apache Airflow
- Databases: PostgreSQL, MS SQL Server, SSIS, SSAS
- Data manipulation: Pandas, NumPy
- Architecture: Medallion Architecture, CDC, Delta Lake MERGE, Dimensional Modeling
- Testing and quality: pytest, Rust tests, SQL validation
- Associate Data Engineer — Alphabridge Consulting, Lahore (Aug – Sep 2026)
- Teaching Assistant, DBMS & Data Warehousing / BI — PUCIT, Lahore (Jan 2025 – Jan 2026)
- Freelance Data Engineer — Self-employed, remote (2023 – Present)
- BS Data Science — University of the Punjab, PUCIT (2022 – 2026)
- Blog: Medium — @shahzeb.dataengineer — writing what I learn from open source
- Email: shahzebali1218@gmail.com
Building reliable data pipelines, one PR at a time.


