Schedule - PGConf NYC 2024

Postgres schema migrations using the expand/contract pattern

Date: 2024-09-30
Time: 15:00–15:50
Room: The Hub
Level: Intermediate

Learn how to do Postgres schema migrations without breaking dependent applications by leveraging the expand/contract pattern.

pgroll is a new open-source migration tool for Postgres that keeps multiple versions of a schema live during a migration, helping you roll out database schema changes without downtime.

Database schema migrations often pose significant challenges to developers, particularly when striving for zero downtime migrations.

There are many things that can go wrong:

• Schema changes breaking client applications
• Unexpected table locking causing downtime
• Human mistakes causing data loss

This talk presents a new approach to schema migrations using an ‘expand/contract’ pattern where multiple versions of a database schema are maintained during the migration, allowing old and new versions of client applications to run side-by-side during an application rollout. Each version of the application sees the version of the database schema with which it is designed to work.

The talks covers the ideas behind this approach, and the challenges to be overcome such as:

• Limitations of existing tools and techniques for Postgres schema migrations.
• The use of Postgres views to present multiple versions of an underlying table.
• Backfilling data between old and new schema versions.
• Techniques to avoid unexpected table locking during migrations.
• Finally we introduce pgroll, an open-source tool that puts these ideas into practice and we show how it can be used to facilitate safe application rollouts across database schema changes.

Speaker

Andrew Farries