This is the repo for [Udacity's Data Engineering NanoDegree Program]
Learn to create relational and NoSQL data models to fit the diverse needs of data consumers. Use ETL to build databases in PostgreSQL and Apache Cassandra.
Sharpen your data warehousing skills and deepen your understanding of data infrastructure. Create cloud-based data warehouses on Amazon Web Services (Redshift)
Understand the big data ecosystem and how to use Spark to work with massive datasets. Store big data in a data lake and query it with Spark. (Pyspark, SparkSQL, DataFrame, AWS S3, EC2, EMR)
Schedule, automate, and monitor data pipelines using Apache Airflow. Run data quality checks, track data lineage, and work with data pipelines in production.
Combine what you've learned throughout the program to build your own data engineering portfolio project.