Topic

#dataflow

Apache Beam

Aug 26, 20265 min read

Beam Runners and Dataflow Cost: Portability vs Workers That Never Scale to Zero

Write-once Beam is real. The Dataflow bill is vCPU-hours plus Shuffle plus Streaming Engine. Streaming jobs keep a worker all night. Spark is cheaper if the team already writes Spark.

beam
dataflow

Illustrated overview of Dataflow vs Dataproc: The Beam Model, the Cost Profiles, and Which One Your Team Can Actually Run

GCP

May 16, 202613 min read

Dataflow vs Dataproc: The Beam Model, the Cost Profiles, and Which One Your Team Can Actually Run

A production comparison of Dataflow and Dataproc on GCP: what Beam buys you, how the two billing models differ, and the team characteristics that decide the choice.

gcp
dataflow