Data Pipelines with Apache Airflow
Audiobook & Ebook

Data Pipelines with Apache Airflow by Julian de Ruiter | Audiobook Review

By Julian de Ruiter

Narrated by Julie Brierley

🎧 10 hours and 18 minutes 📘 Manning Publications 📅 November 22, 2021 🌐 English

About This Audiobook

Data Pipelines with Apache Airflow teaches you how to build and maintain effective data pipelines.

Summary

A successful pipeline moves data efficiently, minimizing pauses and blockages between tasks, and keeping processes along the way operational. Apache Airflow provides a single customizable environment for building and managing data pipelines, eliminating the need for a hodgepodge collection of tools, snowflake code, and homegrown processes. Using real-world scenarios and examples, this book teaches you how to simplify and automate data pipelines, reduce operational overhead, and smoothly integrate all the technologies in your stack.

About the Technology

Data pipelines manage the flow of data from initial collection through consolidation, cleaning, analysis, visualization, and more. Apache Airflow provides a single platform you can use to design, implement, monitor, and maintain your pipelines. It features easy-to-use UI, plug-and-play options, and flexible Python scripting.

About the Book

Data Pipelines with Apache Airflow teaches you how to build and maintain effective data pipelines. You’ll explore the most common usage patterns, including aggregating multiple data sources, connecting to and from data lakes, and cloud deployment. Part reference and part tutorial, this practical guide covers every aspect of the directed acyclic graphs (DAGs) that power Airflow, and how to customize them for your pipeline’s needs.

What's Inside

Build, test, and deploy Airflow pipelines as DAGs
Automate moving and transforming data
Analyze historical datasets using backfilling
Develop custom components
Set up Airflow in production environments

About the Audience

For DevOps, data engineers, machine learning engineers, and sysadmins with intermediate Python skills.

About the Authors

Bas Harenslak and Julian de Ruiter are data engineers with extensive experience using Airflow to develop pipelines for major companies. Bas is also an Airflow committer.

PLEASE NOTE: When you purchase this title, the accompanying PDF will be available in your Audible Library along with the audio.

🎧 Listen Free on Audible

Free 30-day trial · Cancel anytime

Key Details

  • Narrator: Julie Brierley keeps an even, unhurried pace through dense procedural material, and no listener reviews yet confirm how she handles the book's code-heavy passages specifically, but nothing in the delivery works against the material.
  • Subjects: workflow orchestration, DevOps automation, production-grade data engineering practice
  • Tone: methodical and hands-on, closer to a technical seminar than a casual listen
  • Bottom line: a genuinely useful audio companion for intermediate Python engineers already committed to learning Airflow, less so for total beginners.

Duct tape and a single engineer's memory are what hold together most homegrown data pipelines before a tool like Apache Airflow enters the picture, and that exact frustration, what the book itself calls “a hodgepodge collection of tools, snowflake code, and homegrown processes,” is what Data Pipelines with Apache Airflow sets out to fix. I queued up the audiobook edition mainly to see whether a book built around diagrams of directed acyclic graphs could survive translation into pure audio. Julian de Ruiter and Bas Harenslak wrote this as part reference and part tutorial, walking through how Apache Airflow replaces that scattered approach with one customizable environment for building, scheduling, and monitoring pipelines. It targets DevOps engineers, data engineers, machine learning engineers, and sysadmins with intermediate Python skills, and the audiobook mostly respects that target audience instead of watering the material down for a general listener who has never opened a terminal.

The book's real structure becomes clear once you're a few chapters in: it moves from the basics of building and testing a single pipeline as a DAG, through automating the moving and transforming of data, into the more advanced territory of backfilling historical datasets and developing fully custom components. That progression matters for an audio listener specifically, since Airflow's own interface is visual, a graph of tasks and dependencies, yet de Ruiter and Harenslak's prose explains the underlying logic of those graphs in language that stands on its own, describing which tasks block which, how retries and scheduling intervals behave, and why a pipeline that looks clean on a whiteboard can still fail quietly in production. The closing stretch on setting up Airflow in production environments is where the book earns its reference-guide half, since it moves past tutorial exercises into the operational decisions, monitoring, scaling, security, that separate a demo pipeline from one a company actually depends on every day.

Listener reviews back up the sense that this book rewards patience rather than skimming. Evan Volgas praised how it “builds up piece by piece and explains what is going on every step of the way,” which matches my own listening experience: skipping ahead in a technical audiobook is rarely wise, and it's a particularly bad idea here, since later chapters lean on vocabulary introduced earlier without much re-explanation. Gino's review makes a related point from the opposite angle, noting that “you can read the first two chapters and be good to go for fundamentals” before the book spends its remaining hours building on that foundation. Daniel V. singled out something worth flagging too, praising “the emphasis on some counter-intuitive features to prevent beginners from wasting time” on configuration quirks that trip up nearly everyone new to Airflow, the kind of hard-won practical knowledge a purely conceptual overview would skip entirely.

Brierley Stays Out of Idempotency's Way

Julie Brierley narrates, and this is exactly the kind of procedural, terminology-heavy nonfiction where a narrator's job is mostly to stay out of the way: even pacing, clean pronunciation of terms like idempotency and backfilling, and enough space between concepts that a listener can pause and actually absorb a definition before the next one arrives. No listener reviews attached to this title comment on her narration specifically, so I'm assessing this on genre fit rather than a confirmed track record, but the demands of a book this dense are fairly narrow and specific, and nothing in the listening experience suggested a narrator working against the material rather than with it. Technical nonfiction narration lives or dies on exactly this kind of restraint, and Brierley holds that line consistently across all ten hours.

The audiobook also comes bundled with the accompanying PDF that Manning includes with every purchase, and for a book this reliant on code samples and DAG diagrams, that pairing changes how you'd realistically use the audio edition. I'd treat the narration as the layer that explains why a piece of code works, the reasoning behind a scheduling decision, the tradeoff behind choosing one operator over another, while the PDF stays open for the actual syntax and diagrams. That division of labor plays to audio's real strength with technical material: hearing a concept explained in full sentences, with cause and effect spelled out, often sticks better than scanning the same idea in a bulleted list, and Bas Harenslak's standing as an actual Airflow committer gives the explanations a credibility that a purely academic treatment of the same subject wouldn't carry.

Narrating a Visual Tool Without Any Screen

The obvious tension for anyone considering the audio format here is that Airflow itself is a visual tool. A DAG is, by definition, a graph, and no amount of careful narration fully replaces looking at task dependencies laid out on a screen. The book handles this about as well as prose can, describing graph structure in language a listener can follow, but I'd be misleading you if I claimed this fully closes the gap for someone who has never opened the Airflow interface. This is not a book for absolute beginners either, despite how approachable the narration makes it sound moment to moment; the audience description is accurate, and someone without at least intermediate Python and some working sense of how a data pipeline actually breaks in the real world will hit a wall somewhere around the custom components chapter.

It's also worth being honest about the numbers: this title carries a 4.4 rating from 74 listeners at the time of this review, a respectable but modest sample for a technical title with a fairly narrow, specialized audience. That's not a red flag on its own, technical nonfiction of this kind rarely racks up thousands of ratings the way a thriller does, but it does mean you're relying more on the strong reputation Airflow itself has in the data engineering world than on a large body of listener consensus specifically about this audio production. Anyone hoping for a broad crowd-tested verdict on the narration itself should factor that modest sample size into how much weight they put on any single glowing review.

Best as a Second Pass After Real Work

This audiobook makes the most sense for someone already writing Python for a living who needs to actually build and maintain pipelines, not just understand Airflow conceptually for an interview. Commuting data engineers are the obvious use case, and I found the middle chapters worked best as a second or third pass after already spending time in the Airflow interface at work, when the narration's explanations of why a specific pattern exists finally had something concrete to attach themselves to. It also suits a small platform or DevOps team building shared vocabulary before a migration off homegrown scripts.

Go elsewhere if your Python is still shaky or if you need to see a DAG rendered on screen to understand it at all; no amount of good narration turns this into a beginner's first introduction to programming or to data engineering concepts from zero. It's also not the right pick for anyone hoping for a quick, high-level survey of what Airflow does, since the book commits fully to depth over breadth, and that commitment is exactly what makes it valuable to the audience it's actually built for.

Ready to listen?

🎧 Listen to Data Pipelines with Apache Airflow for free

Free 30-day trial · Cancel anytime

What Listeners Are Saying

★★★★★

An excellent resource for learning and using Airflow

This book is great. It builds up piece by piece and explains what is going on every step of the way. It shows you best practices and goes into great detail on relatively advanced topics, in addition to covering all the basics. The code examples can easily be adapted for...

- Evan Volgas
★★★★★

To the Point

This is the type of book where you can read the first two chapters and be good to go for fundamentals. The rest of the book is basically building up on what you learned. Such great instruction packed into a few papers. Probably one of the better written manuals for...

- Gino
★★★★★

A well written and thorough book on Airflow

A great book on Airflow, how operate it, configure it, interface with 3rd party systems (particularly cloud or db related). I particularly liked the emphasis on some counter-intuitive features to prevent beginners from wasting time on figuring a couple of tweaks for themselves.

- Daniel V.
★★★★★

A great guide to Airflow

This is a great guide to Airflow, covering the basics and advanced topics such as how to test dags and running tasks in containers. Highly recommended!

- CWC_NY
★★★★★

Great book

I’ve read a lot of CS books, this is in the top 5. It’s well written and full of domain knowledge.

- Chris Novitsky

Free Listening

Listen to the Audiobook for Free: Data Pipelines with Apache Airflow

  • ✓ Audible: 30-day free trial, your first audiobook free
  • ✓ Cancel anytime in one click
Alexandra Reed

Written by Alexandra Reed

Founder & Literary Critic