Articles

Notes on data engineering, open-source infrastructure, and building data platforms — published across Medium and other outlets.

Dagster on Kubernetes: When More Nodes Won’t Save You

Medium · June 2026 · 7 min read

You’ve scaled up your Kubernetes cluster. EC2 instances are running. CPU and memory metrics look reasonable. And yet — the number of completed Dagster runs stubbornly refuses to climb. If you’ve been in this situation, you know the particular frustration of a platform that looks healthy but processes jobs at a trickle.

Read on Medium →

From Zero to Data Platform in Minutes: The Case for an Open-Source Setup Wizard

Medium · June 2026 · 8 min read

How a simple configuration tool can remove weeks of infrastructure work for solo developers, small teams, and anyone evaluating modern data stacks.

Read on Medium →

From Zero to Running Data Platform in 5 Minutes: A Hands-On Walkthrough

Medium · June 2026 · 7 min read

A step-by-step tutorial using Data Platform Wizard to generate a production-ready Docker stack of a fully equipped Data Platform scaffold.

Read on Medium →

Video Tutorial: Data Platform Wizard Walkthrough

Watch on YouTube →

Published by Wojciech Szyba · dataplatform.dev