Topic

#tutorials

7 posts ·view all posts

Illustrated overview of Airflow Deferrable Operators: Stop Burning Worker Slots on Sensors

Airflow🟡Intermediate

Aug 30, 20269 min read

Airflow Deferrable Operators: Stop Burning Worker Slots on Sensors

How the triggerer frees workers: why classic sensors sleep on a slot, FileSensor vs deferrable waits, and the operational habits that keep deferred tasks from sitting forever.

airflow
tutorials

Illustrated overview of Building Your First Data Pipeline with Python and Airflow

Airflow🟡Intermediate

Aug 20, 20267 min read

Building Your First Data Pipeline with Python and Airflow

A beginner-friendly, step-by-step guide to building your first ETL pipeline — extract data from an API, transform it with pandas, and load it into a database, all scheduled and automated with Apache Airflow.

tutorials
airflow
python

Illustrated overview of SQL Window Functions: The 5 Patterns Every Data Engineer Uses Weekly

SQL🟡Intermediate

Aug 18, 20268 min read

SQL Window Functions: The 5 Patterns Every Data Engineer Uses Weekly

Deduplication, running totals, sessionization, period-over-period comparisons, and top-N per group — plus frames, pitfalls, and live playground queries.

sql
tutorials

Illustrated overview of Data Quality Checks in Python: Catch Bad Data Before Your Users Do

Python🟡Intermediate

Aug 16, 20269 min read

Data Quality Checks in Python: Catch Bad Data Before Your Users Do

A practical framework for adding data quality checks to Python pipelines: what to check, where to check it, and when to fail loudly vs quarantine.

python
data-quality
tutorials

Illustrated overview of dbt Tutorial: Build Your First Transformation Project the Right Way

dbt🟢Beginner

Aug 5, 20266 min read

dbt Tutorial: Build Your First Transformation Project the Right Way

Set up a dbt project from scratch: staging models, marts, tests, and documentation — with the project structure conventions used by real teams.

dbt
sql
tutorials

Illustrated overview of Kafka Fundamentals: Topics, Partitions, and Consumer Groups Explained

Kafka🟡Intermediate

Aug 3, 202611 min read

Kafka Fundamentals: Topics, Partitions, and Consumer Groups Explained

The mental model every data engineer needs before touching Kafka: how topics, partitions, offsets, and consumer groups actually work together.

kafka
streaming
tutorials

Illustrated overview of PySpark for Data Engineers: From Zero to Your First Production Job

Apache Spark🟡Intermediate

Aug 1, 20269 min read

PySpark for Data Engineers: From Zero to Your First Production Job

Learn the PySpark DataFrame API, understand lazy evaluation and partitions, and avoid the classic mistakes that make Spark jobs slow.

spark
python
tutorials