Topic

#tutorials

7 posts ·view all posts

Illustrated overview of Airflow Deferrable Operators: Stop Burning Worker Slots on Sensors

Airflow

Aug 30, 20269 min read

Airflow Deferrable Operators: Stop Burning Worker Slots on Sensors

How the triggerer frees workers: why classic sensors sleep on a slot, FileSensor vs deferrable waits, and the operational habits that keep deferred tasks from sitting forever.

airflow
tutorials

Illustrated overview of Building Your First Data Pipeline with Python and Airflow

Airflow

Aug 20, 20265 min read

Building Your First Data Pipeline with Python and Airflow

Extract from an API, transform with pandas, load to a warehouse — scheduled in Airflow with retries, idempotency, and a local Docker setup.

tutorials
airflow
python

Illustrated overview of SQL Window Functions: The 5 Patterns Every Data Engineer Uses Weekly

SQL

Aug 18, 20268 min read

SQL Window Functions: The 5 Patterns Every Data Engineer Uses Weekly

Deduplication, running totals, sessionization, period-over-period comparisons, and top-N per group — plus frames, pitfalls, and live playground queries.

sql
tutorials

Illustrated overview of Data Quality Checks in Python: Catch Bad Data Before Your Users Do

Python

Aug 16, 20269 min read

Data Quality Checks in Python: Catch Bad Data Before Your Users Do

A practical framework for adding data quality checks to Python pipelines: what to check, where to check it, and when to fail loudly vs quarantine.

python
data-quality
tutorials

Illustrated overview of dbt Tutorial: Build Your First Transformation Project the Right Way

dbt

Aug 5, 20264 min read

dbt Tutorial: Build Your First Transformation Project the Right Way

Set up a dbt project from scratch: staging models, marts, tests, and documentation — with the project structure conventions used by real teams.

dbt
sql
tutorials

Illustrated overview of Kafka Fundamentals: Topics, Partitions, and Consumer Groups Explained

Kafka

Aug 3, 202611 min read

Kafka Fundamentals: Topics, Partitions, and Consumer Groups Explained

The mental model every data engineer needs before touching Kafka: how topics, partitions, offsets, and consumer groups actually work together.

kafka
streaming
tutorials

Illustrated overview of PySpark for Data Engineers: From Zero to Your First Production Job

Apache Spark

Aug 1, 20269 min read

PySpark for Data Engineers: From Zero to Your First Production Job

Learn the PySpark DataFrame API, understand lazy evaluation and partitions, and avoid the classic mistakes that make Spark jobs slow.

spark
python
tutorials