Comments (7)
My opinion: Since the whole spirit of pg-osc is to minimize locking during schema changes, we should do the view replacement outside the other transaction so we don't hold that AccessExlusive any longer than necessary. That said, replacing a view should be nearly instantaneous, so I could see the counter argument. My vote is: outside replay_and_swap
and before drop_and_cleanup
.
from pg-osc.
Thanks once again for the great work!
from pg-osc.
This is a good callout. We should at least mention this in the caveats. Any chance you want to make a PR?
from pg-osc.
Yeah that’s a caveat! I think documentation might have had it at some point. Will add it.
I will try to take a pass it this weekend and see if we can support this feature.
from pg-osc.
Updated README
to reflect the caveat.
from pg-osc.
So, had a chance to think more. Here is a quick summary
I think we can re-create the view in the transaction after we swap the table names here. However, the downside here is we could've kept the exclusive lock open for a while, basically depending on how long it takes to re-create the view. Which can affect performance/reliability of the app.
The other option is - instead of re-creating the view from replay_and_swap!
(like above), it might be worth re-creating it right before drop_and_cleanup
. The assumption here: Having delayed refreshed data within a view is much more preferable than a longer swap time w/ reliability concerns. And, after the views are refreshed, we can successfully drop the old tables too. And if adding/replacing views take a while, thats ok during this part of the proess.
We can use pg_get_viewdef
to get the view definition and swap the name of the op_table*
name with the parent table and perform a CREATE OR REPLACE VIEW...
from pg-osc.
Related Issues (20)
- Perform drop_and_cleanup! on POSIX signals
- Bulk push remaining rows in audit table before swap
- Ability to modify the SQL used to populate the new table HOT 10
- Add additional safety for custom copy sql HOT 2
- fix something on README about installation HOT 5
- operation_type audit table can conflict with column name on the primary table
- Introduce a PK/id field on audit table for ordered reads
- Deprecate -w option for password and replace with PGPASSWORD env
- race condition between replay and swap
- Add foreign keys to shadow table during swap HOT 1
- Integration/smoke test HOT 2
- Signal handler gets stuck on IO somewhere on SIGINT
- Some issues while working with partitioned table HOT 5
- Re-enable autovacuum and fix sequence naming post swap HOT 1
- Feature Request: We want to make it working with the table with trigger HOT 7
- Set the appropriate next sequence value on the new table HOT 11
- 很不错的工具 HOT 1
- Potential need for a `pull-batch-delay` option HOT 4
- Auto-Vacuum Isn't Re-enabled HOT 14
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pg-osc.