Objectifs
- Coding Production Grade Data pipelines by Mastering Airflow through Hands-on Examples,
- How to Scale Airflow with the Local,
- Celery and Kubernetes Wxecutors,
- How to Secure Airflow with authentication, crypto and the RBAC UI,
- Mastering DAGs with timezones, unit testing, backfill and catchup
Programme
- Introduction
- The basics of Apache Airflow
- The Forex Data Pipeline
- Mastering your DAGs
- Distributing Apache Airflow
- Improving your DAGs with advanced concepts
- Deploying Airflow on AWS EKS with Kubernetes Executors and Rancher
- Monitoring Apache Airflow
- Security in Apache Airflow
- Airflow 2.0
- BONUS - APPENDIX
Avis
Max Tarasishin Pros: 1. A lot of valuable information 2. The information will stay relevant for a long time 3. Extremely thorough and practical 4. Can be easily applied IRL Cons: 1. Low code quality 2. There are some dubious and unsecure actions that I advise you against (like posting into the yopmail, copying keys for your GMail, etc)
Diptiranjan Dash Marc has done a good job in compiling all the information and advanced concepts, specially like the kubernetes setup for airflow.Definitely recommend the course to data architects and software engineers out there.
Nathan Zugsay Amazing course. Very thorough and clear on the describing the concepts. I recommend it to anyone interested in learning about airflow