Enterprise-grade, production-hardened, serverless data lake on AWS
-
Updated
Sep 4, 2026 - Python
Enterprise-grade, production-hardened, serverless data lake on AWS
Hands-on technology workshops for enterprise teams covering Data Engineering, Databricks, Snowflake, AWS, DevOps, Cloud, GenAI, AI Agents and LLMOps.
📄 Pipeline de ingestão e análise com AWS Glue, Athena e S3, utilizando arquivos Parquet e catalogação automatizada via Crawler. Permite consultas SQL rápidas e eficientes sobre dados armazenados na nuvem.
Real-time decisions on an electricity distribution network. Deterministic code owns whether a window is closed; models only forecast, score and rank. Seven claims proved offline and against a deployed AWS estate — 0 rows published early of 3,779, 41 gate mutations refused, all six erasure legs confirmed.
A HIPAA-compliant healthcare data lake built on AWS using Medallion Architecture (Bronze/Silver/Gold). Features PySpark ETL pipelines via AWS Glue, column-level security through Lake Formation, serverless SQL with Athena, and a live Tableau dashboard — simulating a real hospital's cloud migration with full governance and monitoring.
Event-driven serverless lakehouse on AWS (Lambda x6 patterns, Step Functions, Glue PySpark, Iceberg, Lake Formation, Superset) — runs end-to-end on LocalStack at zero cost. Terraform IaC + CDKTF parity.
📄 Projeto educacional de pipeline de ingestão de dados utilizando AWS S3 e Lake Formation, estruturando a camada bronze de um Data Lake com Python.
Kinesis Firehose → S3 → Glue → Lake Formation → Athena → QuickSight data platform
Production-style AWS data lakehouse — Terraform, EMR Serverless, Apache Iceberg, and Lake Formation with idempotent Spark writes and governed access.
Cost-conscious, business-first AWS SA portfolio for B2B service provider analytics: anomaly detection, experiment operations, governed NL analytics, and partner support.
AWS banking transaction risk analytics lakehouse using Kinesis, S3, Glue/PySpark, Lambda, Athena, Redshift, Lake Formation, data quality and CI/CD.
To associate your repository with the lake-formation topic, visit your repo's landing page and select "manage topics."