ERROR: invalid memory alloc request size 1073741824

[eulerto]

ERROR: invalid memory alloc request size 1073741824

[eulerto]

@rugging24 what is the exact postgres version? I bet you are using a version < 9.4.8 or version < 9.5.3. If so, update the binaries for the latest minor version (9.4.15, 9.5.10) and try again. There is a lot of nasty bugs around logical decoding in those releases.

[rugging24]

Hi ,
Thanks for the response . My PG version is :

PostgreSQL 9.5.8 on x86_64-pc-linux-gnu, compiled by gcc (Debian 4.9.2-10) 4.9.2, 64-bit

[AGanguli]

We're getting the memory error as well. I think it's happening if there have been a lot of updates while nobody is listening to the replication slot. Then all the changes get sent at once, and I guess there's a 1GB limit.

There should be a maximum message size, after which the updates get split into multiple messages.

[eulerto]

@AGanguli Do you have a test case for me? What is your exact PostgreSQL version?

[AGanguli]

I can try to construct one.

This is 9.6.6. Unfortunately it's Amazon's RDS service - no idea what sort of modifications they've made.

[rcoup]

From AWS (16 Nov):

Currently we are using 645ab69 as the latest supported wal2json commit.

[eulerto]

Use parameter write-in-chunks. Unfortunately, this is a limitation of PostgreSQL allocation infrastructure.