5 posts
How I protect 15+ projects across Python, JavaScript, and Rust from supply chain attacks using a three-layer defence: registry-level delays, automated PR scheduling, and lockfile discipline.
Convention-driven PRD-to-HLD-to-LLD pipelines and why schema-gen should be your first commit.
Start from a single business SLA — data freshness under 60 seconds — and trace backwards through dependency trees, metadata layers, known-error memory, and automated fixes to build an AI-operated production platform.
Uptime tools tell you a service is running. Gatus tells you the data pipeline is actually working. How I use 73 custom health checks to monitor infrastructure, data freshness, and pipeline completeness.
Building a benchmarking utility for shuffle and network transfer metrics in Databricks clusters.