Marc Lamberti
Apache Airflow is a platform created by community to programmatically author, schedule and monitor workflows.
It is scalable, dynamic, extensible and modulable.
Without any doubts, mastering Airflow is becoming a must–have and an attractive skill for anyone working with data.
What you will learn in the course:
Fundamentals of Airflow are explained such as what is Airflow, how the scheduler and the web server works
The Forex Data Pipeline project is incredible way to discover many operators in Airflow and deal with Slack, Spark, Hadoop and more
Mastering your DAGs is a top priority and you will be able to play with timezones, unit testing your DAGs, how to structure your DAG folder and much more
Scaling Airflow through different executors such as the Local Executor, the Celery Executor and the Kubernetes Executor will be explained in details. You will discover how to specialise your workers, how to add new workers, what happens when a node crashes.
A Kubernetes cluster of 3 nodes will be set up with Rancher, Airflow and the Kubernetes Executor in local to run your data pipelines.
Advanced concepts will be shown through practical examples such as templatating your DAGs, how to make your DAG dependent of another, what are Subdags and deadlocks, and more.
Instructor Details
Courses : 2
Specification: Apache Airflow: The Hands-On Guide
|
26 reviews for Apache Airflow: The Hands-On Guide
Add a review
| Price | $9.99 |
|---|---|
| Provider | |
| Duration | 14 hours |
| Year | 2022 |
| Level | All |
| Language | English |
| Certificate | Yes |
| Quizzes | No |
$9.99
Francois Xavier –
Very good presentation
Nici Podskalan –
Excellent course!
Reeves Smith –
Marc does it again. Really great course that adds more advanced knowledge of Airflow. The lab materials are fantastic and a great resource to follow along with the concepts within the course. The labs use docker which makes a perfect development setup that would be a great starting point for any developer/team. Marc covers the distributed Airflow setup and has labs that walk through different setups that allow you to try things like a celery setup and how to add additional nodes. The section on monitoring section is full of detail that I have not seen in the other courses. Really liked this section, it offered me some additional knowledge to enhance my airflow monitoring. Could not recommend the course more. Do go through Marc s first course if you are new to airflow and follow up with this one after.
Noam Natan –
Great material and excellent communication with the instructor.
Benjamin Elkrieff –
Amazing course! Marc really be saving lives with this courses. Another master piece. Keep up the good work !!!
Naga A –
Easily one of the best courses on the internet to get started and truly understand Airflow. Highly recommend to anyone looking to get started with this technology.
Thierry PARET –
Very complete airflow training
Ram Mady –
Awesome course.
Igor Maffei Libonati Maia –
Fala muito r pido, fazendo que sua pronucia seja dificil de entender.
aymen ayadi –
to be honest, Marc is so talented, the course is awesome, it digs into the details and provide advanced and best practice for production solution ! keep going.
Szabolcs Vasas –
I took this course to be able to have a better understanding of data pipelines, data engineering and Airflow, I was a beginner at this topic. It’s a great course, I have a much better understanding of this domain now, I love that it is very practical and it goes into the related technologies like Docker, Kubernetes, AWS.
Jeniffer Abigail Mart nez Baez –
En lo absoluto, tiene muy buenas base te ricas y un excelente material, lo recomiedo
Alex Kennedy –
Top notch instruction. I like that the videos are short and easy to go back and watch over and over.
Samuel Duan –
Marc is an awesome instructor! Particularly, (1) the course design and hands on section cover a lot of use cases and are very applicable to the pipeline in real life. (2) I got stuck at section 3 as I was setting airflow and docker in my win 7 PC. It was challenging because the various limitation that docker in win 7 has. However, Marc spend many hours and even stayed up until 2am to help me debug the config. I am so grateful for his tremendous sacrifice for caring his students.
Max Tarasishin –
Pros: 1. A lot of valuable information 2. The information will stay relevant for a long time 3. Extremely thorough and practical 4. Can be easily applied IRL Cons: 1. Low code quality 2. There are some dubious and unsecure actions that I advise you against (like posting into the yopmail, copying keys for your GMail, etc)
ANDREI PETRESCU –
Excellent course, the teacher is very good and the material is comprehensive.
Marcos Marx Millnitz –
Very good course! It’s really a hands on with complex example
Vishwas –
marc will help by one to one interactions irrespective of the scope of the course, feel free to switch to 0.75x speed if you find the ascent fast ! 🙂
Kalidas T –
bit fast explanation bu good
Playgames –
One of the best courses I have taken on udemy. Thank you for sharing this content.
Ron Manalang –
can’t understand the trainer
Ramesh Mishra –
great content
Steven Smith –
This course is full of information and it is taught very well by the instructor.
Adolfo Camacho Yague –
Excellent explanations
Ori Hendel –
clear and friendly
Patricio S –
From section 4, the quality of the course decreased dramatically.