This Airflow DAG automates the process of extracting data from an Amazon Redshift database and unloading it to Amazon S3 in Parquet format. It runs daily, exporting data from the previous day based on a specified query.
data-migration amazon-redshift data-pipeline workflow-automation data-export amazon-s3 apache-airflow parquet-format dag-scheduling unload-queey unload-query
-
Updated
Dec 25, 2024 - Python