Topic

#pipelines

Illustrated overview of Snowflake Dynamic Tables: TARGET_LAG, Refresh Warehouses, and When to Keep dbt

Snowflake🟡Intermediate

Aug 30, 202610 min read

Snowflake Dynamic Tables: TARGET_LAG, Refresh Warehouses, and When to Keep dbt

How Dynamic Tables actually refresh: TARGET_LAG, the warehouse that pays for it, streams vs DT, and why I still keep dbt for gold.

snowflake
pipelines
sql

Illustrated overview of Snowflake Streams and Tasks: Incremental Apply, Schedules, and When Airflow Still Owns the Graph

Snowflake🟡Intermediate

Aug 30, 202610 min read

Snowflake Streams and Tasks: Incremental Apply, Schedules, and When Airflow Still Owns the Graph

CREATE STREAM on a table, consume it in a Task MERGE, SHOW STREAMS, stale offsets, and the cases where Airflow still orchestrates dbt and everything outside Snowflake.

snowflake
pipelines

Illustrated overview of Declarative Pipelines in Databricks: Expectations, Streaming Tables, and When the Abstraction Fights You

Databricks🟡Intermediate

May 16, 202610 min read

Declarative Pipelines in Databricks: Expectations, Streaming Tables, and When the Abstraction Fights You

What DLT genuinely buys you, how expectations and streaming tables behave in production, and the four situations where I still write plain Spark jobs instead.

databricks
pipelines