Airflow Operators cheat sheet with Shrividya Hegde

Shrividya Hegde

profile
Best Seller

Airflow Operators cheat sheet

Data Engineer and AI Practitioner

11 ratings and 24 bookings across all services

profile
Digital Product

About this product

A working reference for the operator and sensor decisions you make while writing DAGs, not a rehash of the API docs.

What's on it:

  • Core operators and provider operators, with a decision tree for picking one
  • Sensor modes, and a timeline diagram showing how much worker capacity poke, reschedule, and deferrable each burn
  • Trigger rules, including none_failed_min_one_success, the one you need when joining branches back together
  • TaskFlow vs classic operators, dynamic task mapping with .expand()
  • XComs and what not to put in them
  • Retries, timeouts, and templating

Written against both 2.x and 3.x, with the Airflow 3 breakages called out where they matter: SLAs removed in favor of Deadline Alerts, SubDAGs gone, execution_date and its variants no longer available, catchup now defaulting to False. If you're planning an upgrade, those four notes alone will save your time.

$7