Airflow in Practice: How I Learned to Stop Worrying and Love DAGs
4:15pm - 4:40pm on Saturday, October 5 in PennTop NorthSarah Schattschneider
- Slides:
- https://github.com/sschatts/conference_talks/blob/master/20191005_pygotham_airflow_in_practice.pdf
- Watch:
- https://youtu.be/mNbwladtr8Q
Description
Heard of Apache Airflow? Do you work with Apache Airflow or want to work with Apache Airflow? Ever wonder how to test Airflow better? Have you considered all data workflow use cases for Airflow? Come be reminded of key concepts and then we will dive into Airflow’s value add, common use cases, and best practices. Some of the use cases that will be discussed include, Extract Transform Load (ETL) jobs, efficiently snapshot databases, and ML feature extraction.