I finally finished my albatross project: replicating all our Postgres shards to Databricks. This is great news.In broad strokes, we export our Postgres databases daily from the backup snapshot, then ingest those Parquet snapshots with Databricks. Previously, we had done a hacked-together variant of the same process using only
No comments yet. Log in to reply on the Fediverse. Comments will appear here.