Orchestration — Airflow in depth, backfills, idempotent DAGs¶
Every data pipeline you have met so far in this book — the lakehouse loads, the dbt runs, the warehouse transforms — has to be started by something, at the right time, in the right order, with the right behavior when a step fails at 3 a.m. That "something" is an orchestrator, and the de-facto standard in data engineering is Apache Airflow (born at Airbnb in 2015, a top-level Apache project since 2019, and by most surveys the single most-deployed data tool after the warehouse itself). …
🔒 La suite est en accès freemium — lecture complète 100 % gratuite
Tu lis ici l'aperçu libre. Le reste du chapitre (code, schémas, maths, exercices) fait partie du livre complet : crée un compte gratuit (30 secondes, aucun paiement) pour tout lire.