Prerequisites
- Docker / Docker Compose
- Confluent Cloud account
Follow the example in the Confluent docs on Tableflow Quick Start with Iceberg Tables Using Managed Storage in Confluent Cloud.
The examples in this repo are a showcase of Step 4: Query Iceberg tables from Spark.
For AWS go to aws-spark
- Update
AWS_REGIONin docker-compose.yml - Run
docker compose up - Navigate to
http://localhost:8888/notebooks/notebooks/tableflow-managed-aws.ipynb(once started) - Update the
TABLEFLOW_variables with your values from Confluent Cloud
For Azure go to azure-spark
- Run
docker compose up - Navigate to
http://localhost:8888/notebooks/notebooks/tableflow-managed-azure.ipynb(once started) - Update the
TABLEFLOW_variables with your values from Confluent Cloud