S3 Tables vs Iceberg on S3: When Managed Compaction Is Worth Paying For

Managed Iceberg is not a storage upgrade, it is a decision about who owns compaction, snapshot expiry and orphan cleanup. A practical comparison of S3 Tables against Iceberg in general purpose S3 buckets, covering the maintenance you actually get, the Lake Formation trap in the access path, how the two bills are shaped, and a seven-step decision procedure you can run against a single table.

Continue ReadingS3 Tables vs Iceberg on S3: When Managed Compaction Is Worth Paying For

GPS Data Gets Ugly Fast: A Fleet GPS Data Pipeline That Stays Queryable

Telematics devices lie in specific, documented ways: stale fixes reported as new, zero coordinates after reboot, and buffered records replayed days late. Here is how to build a fleet GPS data pipeline on PostgreSQL, PostGIS and TimescaleDB that survives all three and still answers trip and geofence queries fast.

Continue ReadingGPS Data Gets Ugly Fast: A Fleet GPS Data Pipeline That Stays Queryable

Athena Partitioning: Why Your Queries Are Still Slow

Partitioning an Athena table is not the same as getting the benefit of it. A walkthrough of the three failure families behind slow queries on partitioned external data: predicates that never prune, catalog lookups that dominate planning, and file layouts that undo everything. Includes partition projection trade-offs, Glue partition indexes, compaction patterns, and how to tell which problem you have.

Continue ReadingAthena Partitioning: Why Your Queries Are Still Slow

SageMaker Unified Studio: What It Replaces, and What It Quietly Doesn’t

SageMaker Unified Studio is a front door, not a runtime. It consolidates the interface while leaving your bill, your IAM design and your infrastructure as code exactly where they were, and it quietly hands you a DataZone governance system to operate. Here is what it genuinely replaces, what it doesn't, the failure modes that bite during adoption, and how to decide whether it is worth it for your team.

Continue ReadingSageMaker Unified Studio: What It Replaces, and What It Quietly Doesn’t

Building an Ecommerce Recommendation Pipeline on AWS: The Parts That Bite

An idle Amazon Personalize setup does not throw errors. It just bills. A practical walkthrough of the five decisions that shape an AWS ecommerce recommendation pipeline: domain recommenders versus custom recipes, bulk versus streaming ingestion, schema limits, training cadence, and real-time versus batch serving, with the failure modes that stay invisible until the invoice arrives.

Continue ReadingBuilding an Ecommerce Recommendation Pipeline on AWS: The Parts That Bite

The Delay Was in the Data Three Weeks Ago: Building a Construction Early Warning Dashboard

Schedule delay rarely arrives as a surprise. It sits in float erosion, aging RFIs and slipping weekly commitments long before the monthly update moves the finish date. Here is how to build a dashboard that catches it while there is still float left to spend.

Continue ReadingThe Delay Was in the Data Three Weeks Ago: Building a Construction Early Warning Dashboard

Parquet vs JSON vs CSV: What Each Format Actually Costs You

Format choice shows up as a bill, not a performance complaint. A working breakdown of where the money actually goes across Parquet, JSON and CSV: column pruning, row-group skipping, the gzip splittability trap, and request overhead. Includes a procedure for measuring the difference on your own data, and an honest account of where Parquet costs you.

Continue ReadingParquet vs JSON vs CSV: What Each Format Actually Costs You

S3 Tables Compaction in Production: The Cost of Convenience

Managed Iceberg compaction in S3 Tables removes real operational work, but it will not tell you when it stops. A practical look at the maintenance jobs that fail silently, the retention cascade that keeps superseded data on your bill for two weeks, how compaction charges actually accumulate, and the handful of knobs worth touching.

Continue ReadingS3 Tables Compaction in Production: The Cost of Convenience