Data Pipelines with Apache Airflow, Second Edition
Data Pipelines with Apache Airflow, Second Edition
Orchestration for Data and AI
Ruiter, Julian
Manning Publications
02/2026
512
Dura
Inglês
9781633436374
15 a 20 dias
Descrição não disponível.
PART 1: GETTING STARTED
1 MEET APACHE AIRFLOW
2 ANATOMY OF AN AIRFLOW DAG
3 TIME-BASED SCHEDULING IN AIRFLOW
4 ASSET-AWARE SCHEDULING
5 TEMPLATING TASKS USING THE AIRFLOW CONTEXT
PART 2: BEYOND THE BASICS
6 DEFINING DEPENDENCIES BETWEEN TASKS
7 TRIGGERING WORKFLOWS WITH EXTERNAL INPUT
8 COMMUNICATING WITH EXTERNAL SYSTEMS
9 EXTENDING AIRFLOW WITH CUSTOM OPERATORS AND SENSORS
10 TESTING
PART 3: AIRFLOW IN PRACTICE
11 RUNNING TASKS IN CONTAINERS
12 BEST PRACTICES
13 PROJECT: FINDING THE FASTEST WAY TO GET AROUND NYC
PART 4: AIRFLOW IN PRODUCTION
14 PROJECT: KEEPING FAMILY TRADITIONS ALIVE WITH AIRFLOW AND GENERATIVE AI
15 OPERATING AIRFLOW IN PRODUCTION
16 SECURING AIRFLOW
17 AIRFLOW DEPLOYMENT OPTIONS
APPENDICES
APPENDIX A: RUNNING CODE SAMPLES
APPENDIX B: PROMETHEUS METRIC MAPPING
1 MEET APACHE AIRFLOW
2 ANATOMY OF AN AIRFLOW DAG
3 TIME-BASED SCHEDULING IN AIRFLOW
4 ASSET-AWARE SCHEDULING
5 TEMPLATING TASKS USING THE AIRFLOW CONTEXT
PART 2: BEYOND THE BASICS
6 DEFINING DEPENDENCIES BETWEEN TASKS
7 TRIGGERING WORKFLOWS WITH EXTERNAL INPUT
8 COMMUNICATING WITH EXTERNAL SYSTEMS
9 EXTENDING AIRFLOW WITH CUSTOM OPERATORS AND SENSORS
10 TESTING
PART 3: AIRFLOW IN PRACTICE
11 RUNNING TASKS IN CONTAINERS
12 BEST PRACTICES
13 PROJECT: FINDING THE FASTEST WAY TO GET AROUND NYC
PART 4: AIRFLOW IN PRODUCTION
14 PROJECT: KEEPING FAMILY TRADITIONS ALIVE WITH AIRFLOW AND GENERATIVE AI
15 OPERATING AIRFLOW IN PRODUCTION
16 SECURING AIRFLOW
17 AIRFLOW DEPLOYMENT OPTIONS
APPENDICES
APPENDIX A: RUNNING CODE SAMPLES
APPENDIX B: PROMETHEUS METRIC MAPPING
Este título pertence ao(s) assunto(s) indicados(s). Para ver outros títulos clique no assunto desejado.
Apache Airflow; data pipelines; workflow automation; data engineering; Airflow DAGs; pipeline orchestration; data workflow management; Taskflow API; generative AI pipelines; machine learning with Airflow; containerized workflows; Kubernetes Airflow
PART 1: GETTING STARTED
1 MEET APACHE AIRFLOW
2 ANATOMY OF AN AIRFLOW DAG
3 TIME-BASED SCHEDULING IN AIRFLOW
4 ASSET-AWARE SCHEDULING
5 TEMPLATING TASKS USING THE AIRFLOW CONTEXT
PART 2: BEYOND THE BASICS
6 DEFINING DEPENDENCIES BETWEEN TASKS
7 TRIGGERING WORKFLOWS WITH EXTERNAL INPUT
8 COMMUNICATING WITH EXTERNAL SYSTEMS
9 EXTENDING AIRFLOW WITH CUSTOM OPERATORS AND SENSORS
10 TESTING
PART 3: AIRFLOW IN PRACTICE
11 RUNNING TASKS IN CONTAINERS
12 BEST PRACTICES
13 PROJECT: FINDING THE FASTEST WAY TO GET AROUND NYC
PART 4: AIRFLOW IN PRODUCTION
14 PROJECT: KEEPING FAMILY TRADITIONS ALIVE WITH AIRFLOW AND GENERATIVE AI
15 OPERATING AIRFLOW IN PRODUCTION
16 SECURING AIRFLOW
17 AIRFLOW DEPLOYMENT OPTIONS
APPENDICES
APPENDIX A: RUNNING CODE SAMPLES
APPENDIX B: PROMETHEUS METRIC MAPPING
1 MEET APACHE AIRFLOW
2 ANATOMY OF AN AIRFLOW DAG
3 TIME-BASED SCHEDULING IN AIRFLOW
4 ASSET-AWARE SCHEDULING
5 TEMPLATING TASKS USING THE AIRFLOW CONTEXT
PART 2: BEYOND THE BASICS
6 DEFINING DEPENDENCIES BETWEEN TASKS
7 TRIGGERING WORKFLOWS WITH EXTERNAL INPUT
8 COMMUNICATING WITH EXTERNAL SYSTEMS
9 EXTENDING AIRFLOW WITH CUSTOM OPERATORS AND SENSORS
10 TESTING
PART 3: AIRFLOW IN PRACTICE
11 RUNNING TASKS IN CONTAINERS
12 BEST PRACTICES
13 PROJECT: FINDING THE FASTEST WAY TO GET AROUND NYC
PART 4: AIRFLOW IN PRODUCTION
14 PROJECT: KEEPING FAMILY TRADITIONS ALIVE WITH AIRFLOW AND GENERATIVE AI
15 OPERATING AIRFLOW IN PRODUCTION
16 SECURING AIRFLOW
17 AIRFLOW DEPLOYMENT OPTIONS
APPENDICES
APPENDIX A: RUNNING CODE SAMPLES
APPENDIX B: PROMETHEUS METRIC MAPPING
Este título pertence ao(s) assunto(s) indicados(s). Para ver outros títulos clique no assunto desejado.