pgcopydb
pgcopydb copied to clipboard
dimitri
Error resetting sequences values on the target database
I am getting error resetting sequences on target database. Using version 0.15-1.pgdg22.04+1 running from PG13 source to PG14 target in AWS Aurora for PostgreSQL. Still chokes on malloc error in STEP 9 when resetting sequences values
pycopydb was not creating the extensions, even though it found them, so I pre-created extensions in target before running :
pgcopydb clone mydb --table-jobs 1 --index-jobs 1 --skip-extensions --debug --fail-fast
13:53:37.049 8095 INFO Running pgcopydb version 0.15-1.pgdg22.04+1 from "/usr/bin/pgcopydb"
13:53:37.051 8095 INFO [SOURCE] Copying database from "postgres://[email protected]:5432/mydb?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
13:53:37.051 8095 INFO [TARGET] Copying database into "postgres://[email protected]:5432/mydb?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
13:53:37.076 8095 INFO Using work dir "/tmp/pgcopydb"
13:53:37.102 8095 INFO Exported snapshot "00000007-000072FA-1" from the source database
13:53:37.118 8101 INFO STEP 1: fetch source database tables, indexes, and sequences
13:53:45.026 8101 INFO Fetched information for 138 tables (including 0 tables split in 0 partitions total), with an estimated total of 245 10 tuples and 360 MB on-disk
13:53:46.416 8101 INFO Fetched information for 215 indexes (supporting 108 constraints)
13:53:46.486 8101 INFO Fetching information for 17 sequences
13:53:46.636 8101 INFO Fetched information for 5 extensions
13:53:47.310 8101 INFO Found 0 indexes (supporting 0 constraints) in the target database
13:53:47.320 8101 INFO STEP 2: dump the source database schema (pre/post data)
13:53:47.324 8101 INFO /usr/bin/pg_dump -Fc --snapshot 00000007-000072FA-1 --section pre-data --file /tmp/pgcopydb/schema/pre.dump 'postgres://[email protected]:5432/mydb?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60'
13:53:49.064 8101 INFO /usr/bin/pg_dump -Fc --snapshot 00000007-000072FA-1 --section post-data --file /tmp/pgcopydb/schema/post.dump 'postgres://[email protected]:5432/mydb?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60'
13:53:50.366 8101 INFO STEP 3: restore the pre-data section to the target database
13:53:50.385 8101 INFO ALTER DATABASE mydb SET "search_path" TO '$user', 'public', 'sde';
13:53:50.437 8101 INFO /usr/bin/pg_restore --dbname 'postgres://[email protected]:5432/mydb?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60' --jobs 4 --use-list /tmp/pgcopydb/schema/pre-filtered.list /tmp/pgcopymydb/schema/pre.dump
13:53:53.914 8112 INFO STEP 4: starting 4 table-data COPY processes
13:53:53.916 8111 INFO COPY extension "postgis" configuration table public.spatial_ref_sys
13:53:53.930 8115 INFO STEP 8: starting 4 VACUUM processes
13:53:53.938 8113 INFO STEP 6: starting 4 CREATE INDEX processes
13:53:53.938 8113 INFO STEP 7: constraints are built by the CREATE INDEX processes
13:53:53.945 8101 INFO Skipping large objects: none found.
13:53:53.950 8101 INFO STEP 9: reset sequences values
13:53:53.965 8129 INFO Reset sequences values on the target database
malloc(): invalid size (unsorted)
13:53:55.051 8101 ERROR Sub-process 8111 exited with code 0 and signal Segmentation fault
13:53:56.036 8112 ERROR Sub-process 8116 exited with code 0 and signal Aborted
malloc(): invalid size (unsorted)
13:53:59.038 8112 ERROR Sub-process 8114 exited with code 0 and signal Aborted
13:54:11.046 8112 ERROR Some COPY worker process(es) have exited with error, see above for details
13:54:11.046 8112 ERROR Failed to copy table data, see above for details
13:54:11.062 8101 ERROR Sub-process 8112 exited with code 12
13:54:11.262 8101 ERROR Some sub-processes have exited with error status, see above for details
13:54:11.262 8101 ERROR Errors detected, see above for details
13:54:11.262 8101 FATAL Failed to COPY the data, see above for details
13:54:11.262 8101 ERROR Failed to clone source database, see above for details
13:54:11.333 8095 ERROR clone process 8101 has terminated [6]
Please consider running in debug mode (using --debug) and reporting useful information for us to be able to help you and fix the bug.
Well there is not a single NOTICE or DEBUG message in the output, and we're lacking filename and line number in the output also. Is it possible that you didn't share the output you intended to share?
Looks the same. I didn't change the name of the database this time, but otherwise it looks the same. No NOTICE or DEBUG outputs. Does it matter where that goes on the command line. I put it last as seen below:
pgcopydb clone daf05 --table-jobs 1 --index-jobs 1 --skip-extensions --debug
ubuntu@ip-10-230-167-20:~$ pgcopydb clone daf05 --table-jobs 1 --index-jobs 1 --skip-extensions --debug
14:26:34.100 2347 INFO Running pgcopydb version 0.15-1.pgdg22.04+1 from "/usr/bin/pgcopydb"
14:26:34.102 2347 INFO [SOURCE] Copying database from "postgres://myuser@egis-test-clone-cluster.cv6mel82oghq.us-east-1.rds.amazonaws.c om:5432/daf05?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
14:26:34.102 2347 INFO [TARGET] Copying database into "postgres://[email protected]:5432/da f05?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
14:26:34.131 2347 INFO Using work dir "/tmp/pgcopydb"
14:26:34.153 2347 INFO Exported snapshot "00000009-00003231-1" from the source database
14:26:34.169 2349 INFO STEP 1: fetch source database tables, indexes, and sequences
14:26:42.253 2349 INFO Fetched information for 138 tables (including 0 tables split in 0 partitions total), with an estimated total of 24 5 10 tuples and 360 MB on-disk
14:26:43.849 2349 INFO Fetched information for 215 indexes (supporting 108 constraints)
14:26:43.934 2349 INFO Fetching information for 17 sequences
14:26:44.099 2349 INFO Fetched information for 5 extensions
14:26:44.818 2349 INFO Found 0 indexes (supporting 0 constraints) in the target database
14:26:44.828 2349 INFO STEP 2: dump the source database schema (pre/post data)
14:26:44.832 2349 INFO /usr/bin/pg_dump -Fc --snapshot 00000009-00003231-1 --section pre-data --file /tmp/pgcopydb/schema/pre.dump 'post gres://myuser@egis-test-clone-cluster.cv6mel82oghq.us-east-1.rds.amazonaws.com:5432/daf05?keepalives=1&keepalives_idle=10&keepalives_inte rval=10&keepalives_count=60'
14:26:46.387 2349 INFO /usr/bin/pg_dump -Fc --snapshot 00000009-00003231-1 --section post-data --file /tmp/pgcopydb/schema/post.dump 'po stgres://myuser@egis-test-clone-cluster.cv6mel82oghq.us-east-1.rds.amazonaws.com:5432/daf05?keepalives=1&keepalives_idle=10&keepalives_in terval=10&keepalives_count=60'
14:26:47.635 2349 INFO STEP 3: restore the pre-data section to the target database
14:26:47.656 2349 INFO ALTER DATABASE daf05 SET "search_path" TO '$user', 'public', 'sde';
14:26:47.708 2349 INFO /usr/bin/pg_restore --dbname 'postgres://[email protected]:5432/daf 05?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60' --jobs 4 --use-list /tmp/pgcopydb/schema/pre-filtered.list / tmp/pgcopydb/schema/pre.dump
14:26:51.014 2360 INFO STEP 4: starting 4 table-data COPY processes
14:26:51.026 2359 INFO COPY extension "postgis" configuration table public.spatial_ref_sys
14:26:51.032 2363 INFO STEP 8: starting 4 VACUUM processes
14:26:51.042 2361 INFO STEP 6: starting 4 CREATE INDEX processes
14:26:51.042 2361 INFO STEP 7: constraints are built by the CREATE INDEX processes
14:26:51.054 2349 INFO Skipping large objects: none found.
14:26:51.060 2349 INFO STEP 9: reset sequences values
14:26:51.079 2377 INFO Reset sequences values on the target database
malloc(): invalid size (unsorted)
14:26:52.161 2349 ERROR Sub-process 2359 exited with code 0 and signal Segmentation fault
14:26:53.239 2360 ERROR Sub-process 2364 exited with code 0 and signal Aborted
malloc(): invalid size (unsorted)
14:26:55.041 2360 ERROR Sub-process 2365 exited with code 0 and signal Aborted
14:27:06.348 2360 ERROR Some COPY worker process(es) have exited with error, see above for details
14:27:06.348 2360 ERROR Failed to copy table data, see above for details
14:27:06.370 2349 ERROR Sub-process 2360 exited with code 12
14:27:06.570 2349 ERROR Some sub-processes have exited with error status, see above for details
14:27:06.570 2349 ERROR Errors detected, see above for details
14:27:06.570 2349 FATAL Failed to COPY the data, see above for details
14:27:06.570 2349 ERROR Failed to clone source database, see above for details
14:27:06.582 2347 ERROR clone process 2349 has terminated [6]
ubuntu@ip-10-230-167-20:~$
I did a "sudo apt upgrade pgcopydb" and ran again. Now I am seeing some meaningful failures SQLite database is locked messages, but up through step 9 still looks the same.
ubuntu@ip-10-230-167-20:~$ pgcopydb clone daf05 --table-jobs 1 --index-jobs 1 --skip-extensions --debug
15:51:39.664 4908 INFO Running pgcopydb version 0.15-1.pgdg22.04+1 from "/usr/bin/pgcopydb"
15:51:39.665 4908 INFO [SOURCE] Copying database from "postgres://[email protected]:5432/daf05?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
15:51:39.665 4908 INFO [TARGET] Copying database into "postgres://[email protected]:5432/daf05?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60"
15:51:39.692 4908 INFO Using work dir "/tmp/pgcopydb"
15:51:39.720 4908 INFO Exported snapshot "00000009-0000778C-1" from the source database
15:51:39.723 4910 INFO STEP 1: fetch source database tables, indexes, and sequences
15:51:47.494 4910 INFO Fetched information for 138 tables (including 0 tables split in 0 partitions total), with an estimated total of 245 10 tuples and 360 MB on-disk
15:51:49.120 4910 INFO Fetched information for 215 indexes (supporting 108 constraints)
15:51:49.203 4910 INFO Fetching information for 17 sequences
15:51:49.348 4910 INFO Fetched information for 5 extensions
15:51:50.069 4910 INFO Found 0 indexes (supporting 0 constraints) in the target database
15:51:50.114 4910 INFO STEP 2: dump the source database schema (pre/post data)
15:51:50.135 4910 INFO /usr/bin/pg_dump -Fc --snapshot 00000009-0000778C-1 --section pre-data --file /tmp/pgcopydb/schema/pre.dump 'postgres://[email protected]:5432/daf05?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60'
15:51:51.400 4910 INFO /usr/bin/pg_dump -Fc --snapshot 00000009-0000778C-1 --section post-data --file /tmp/pgcopydb/schema/post.dump 'postgres://[email protected]:5432/daf05?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60'
15:51:52.659 4910 INFO STEP 3: restore the pre-data section to the target database
15:51:52.680 4910 INFO ALTER DATABASE daf05 SET "search_path" TO '$user', 'public', 'sde';
15:51:52.733 4910 INFO /usr/bin/pg_restore --dbname 'postgres://[email protected]:5432/daf05?keepalives=1&keepalives_idle=10&keepalives_interval=10&keepalives_count=60' --jobs 4 --use-list /tmp/pgcopydb/schema/pre-filtered.list /tmp/pgcopydb/schema/pre.dump
15:51:56.186 4924 INFO STEP 4: starting 4 table-data COPY processes
15:51:56.187 4923 INFO COPY extension "postgis" configuration table public.spatial_ref_sys
15:51:56.208 4927 INFO STEP 8: starting 4 VACUUM processes
15:51:56.219 4925 INFO STEP 6: starting 4 CREATE INDEX processes
15:51:56.219 4925 INFO STEP 7: constraints are built by the CREATE INDEX processes
15:51:56.222 4910 INFO Skipping large objects: none found.
15:51:56.243 4910 INFO STEP 9: reset sequences values
15:51:56.251 4941 INFO Reset sequences values on the target database
malloc(): invalid size (unsorted)
15:51:57.344 4910 ERROR Sub-process 4923 exited with code 0 and signal Segmentation fault
15:51:58.315 4924 ERROR Sub-process 4930 exited with code 0 and signal Aborted
malloc(): invalid size (unsorted)
15:52:00.717 4924 ERROR Sub-process 4926 exited with code 0 and signal Aborted
15:52:07.682 4928 ERROR Failed to step through statement: select attnum, count(*) over() as count, attypid, attname, attisprimary, attisgenerated from s_attr where oid = $1 order by attnum
15:52:07.682 4928 ERROR [SQLite] database is locked
15:52:07.682 4928 ERROR Failed to fetch table sde.sde_process_information attribute list, see above for details
15:52:07.682 4928 ERROR Failed to copy data for table with oid 92439676 and part number 0, see above for details
15:52:12.735 4937 ERROR Failed to execute statement: insert or ignore into s_table_indexes_done(tableoid, pid) values($1, $2)
15:52:12.735 4937 ERROR [SQLite 5] database is locked
15:52:12.735 4937 ERROR Failed to execute SQLite query, see above for details
15:52:12.735 4937 ERROR Failed to create index with oid 92447949, see above for details
15:52:17.843 4932 ERROR Failed to execute statement: update vacuum_summary set done_time_epoch = $1, duration = $2 where pid = $3 and tableoid = $4
15:52:17.843 4932 ERROR [SQLite 5] database is locked
15:52:17.843 4932 ERROR Failed to execute SQLite query, see above for details
15:52:17.843 4932 ERROR Failed to vacuum table with oid 92447930, see above for details
15:52:23.114 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:52:23.114 4929 ERROR [SQLite 5] database is locked
15:52:23.114 4929 ERROR Failed to execute SQLite query, see above for details
15:52:23.114 4929 ERROR Failed to copy data for table with oid 92448016 and part number 0, see above for details
15:52:28.308 4938 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:52:28.308 4938 ERROR [SQLite 5] database is locked
15:52:28.308 4938 ERROR Failed to execute SQLite query, see above for details
15:52:28.308 4938 ERROR Failed to track progress in our catalogs, see above for details
15:52:28.308 4938 ERROR Failed to create index with oid 92447969, see above for details
15:52:33.507 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:52:33.507 4929 ERROR [SQLite 5] database is locked
15:52:33.507 4929 ERROR Failed to execute SQLite query, see above for details
15:52:33.507 4929 ERROR Failed to copy data for table with oid 92939086 and part number 0, see above for details
15:52:38.658 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:52:38.658 4937 ERROR [SQLite 5] database is locked
15:52:38.658 4937 ERROR Failed to execute SQLite query, see above for details
15:52:38.658 4937 ERROR Failed to track progress in our catalogs, see above for details
15:52:38.658 4937 ERROR Failed to create index with oid 92447995, see above for details
15:52:43.882 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:52:43.882 4929 ERROR [SQLite 5] database is locked
15:52:43.882 4929 ERROR Failed to execute SQLite query, see above for details
15:52:43.882 4929 ERROR Failed to copy data for table with oid 707772947 and part number 0, see above for details
15:52:48.928 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:52:48.928 4937 ERROR [SQLite 5] database is locked
15:52:48.928 4937 ERROR Failed to execute SQLite query, see above for details
15:52:48.928 4937 ERROR Failed to track progress in our catalogs, see above for details
15:52:48.928 4937 ERROR Failed to create index with oid 94641443, see above for details
15:52:53.975 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:52:53.975 4929 ERROR [SQLite 5] database is locked
15:52:53.975 4929 ERROR Failed to execute SQLite query, see above for details
15:52:53.975 4929 ERROR Failed to copy data for table with oid 707773331 and part number 0, see above for details
15:52:59.111 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:52:59.111 4937 ERROR [SQLite 5] database is locked
15:52:59.111 4937 ERROR Failed to execute SQLite query, see above for details
15:52:59.112 4937 ERROR Failed to track progress in our catalogs, see above for details
15:52:59.112 4937 ERROR Failed to create index with oid 707773207, see above for details
15:53:04.167 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:53:04.167 4929 ERROR [SQLite 5] database is locked
15:53:04.167 4929 ERROR Failed to execute SQLite query, see above for details
15:53:04.167 4929 ERROR Failed to copy data for table with oid 708168002 and part number 0, see above for details
15:53:09.211 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:53:09.211 4937 ERROR [SQLite 5] database is locked
15:53:09.211 4937 ERROR Failed to execute SQLite query, see above for details
15:53:09.211 4937 ERROR Failed to track progress in our catalogs, see above for details
15:53:09.211 4937 ERROR Failed to create index with oid 708167977, see above for details
15:53:14.407 4938 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:53:14.407 4938 ERROR [SQLite 5] database is locked
15:53:14.407 4938 ERROR Failed to execute SQLite query, see above for details
15:53:14.407 4938 ERROR Failed to track progress in our catalogs, see above for details
15:53:14.407 4938 ERROR Failed to create index with oid 708167981, see above for details
15:53:19.503 4940 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:53:19.503 4940 ERROR [SQLite 5] database is locked
15:53:19.503 4940 ERROR Failed to execute SQLite query, see above for details
15:53:19.503 4940 ERROR Failed to track progress in our catalogs, see above for details
15:53:19.503 4940 ERROR Failed to create index with oid 708167982, see above for details
15:53:24.641 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:53:24.641 4929 ERROR [SQLite 5] database is locked
15:53:24.641 4929 ERROR Failed to execute SQLite query, see above for details
15:53:24.641 4929 ERROR Failed to copy data for table with oid 708168372 and part number 0, see above for details
15:53:29.664 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:53:29.664 4937 ERROR [SQLite 5] database is locked
15:53:29.664 4937 ERROR Failed to execute SQLite query, see above for details
15:53:29.664 4937 ERROR Failed to track progress in our catalogs, see above for details
15:53:29.664 4937 ERROR Failed to create index with oid 708168043, see above for details
15:53:34.965 4940 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:53:34.965 4940 ERROR [SQLite 5] database is locked
15:53:34.965 4940 ERROR Failed to execute SQLite query, see above for details
15:53:34.965 4940 ERROR Failed to track progress in our catalogs, see above for details
15:53:34.965 4940 ERROR Failed to create index with oid 708168039, see above for details
15:53:40.267 4939 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:53:40.267 4939 ERROR [SQLite 5] database is locked
15:53:40.267 4939 ERROR Failed to execute SQLite query, see above for details
15:53:40.267 4939 ERROR Failed to track progress in our catalogs, see above for details
15:53:40.267 4939 ERROR Failed to create index with oid 708168044, see above for details
15:53:45.566 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:53:45.566 4929 ERROR [SQLite 5] database is locked
15:53:45.566 4929 ERROR Failed to execute SQLite query, see above for details
15:53:45.566 4929 ERROR Failed to copy data for table with oid 708168498 and part number 0, see above for details
15:53:50.901 4938 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:53:50.901 4938 ERROR [SQLite 5] database is locked
15:53:50.901 4938 ERROR Failed to execute SQLite query, see above for details
15:53:50.901 4938 ERROR Failed to track progress in our catalogs, see above for details
15:53:50.901 4938 ERROR Failed to create index with oid 708168456, see above for details
15:53:55.968 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:53:55.968 4929 ERROR [SQLite 5] database is locked
15:53:55.968 4929 ERROR Failed to execute SQLite query, see above for details
15:53:55.968 4929 ERROR Failed to copy data for table with oid 740951343 and part number 0, see above for details
15:54:01.209 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:54:01.209 4937 ERROR [SQLite 5] database is locked
15:54:01.209 4937 ERROR Failed to execute SQLite query, see above for details
15:54:01.209 4937 ERROR Failed to track progress in our catalogs, see above for details
15:54:01.209 4937 ERROR Failed to create index with oid 740951310, see above for details
15:54:06.545 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:54:06.545 4929 ERROR [SQLite 5] database is locked
15:54:06.545 4929 ERROR Failed to execute SQLite query, see above for details
15:54:06.545 4929 ERROR Failed to copy data for table with oid 762234857 and part number 0, see above for details
15:54:11.652 4940 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:54:11.652 4940 ERROR [SQLite 5] database is locked
15:54:11.652 4940 ERROR Failed to execute SQLite query, see above for details
15:54:11.652 4940 ERROR Failed to track progress in our catalogs, see above for details
15:54:11.652 4940 ERROR Failed to create index with oid 748790646, see above for details
15:54:16.662 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:54:16.662 4929 ERROR [SQLite 5] database is locked
15:54:16.662 4929 ERROR Failed to execute SQLite query, see above for details
15:54:16.662 4929 ERROR Failed to copy data for table with oid 986989667 and part number 0, see above for details
15:54:21.771 4940 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:54:21.771 4940 ERROR [SQLite 5] database is locked
15:54:21.771 4940 ERROR Failed to execute SQLite query, see above for details
15:54:21.771 4940 ERROR Failed to track progress in our catalogs, see above for details
15:54:21.771 4940 ERROR Failed to create index with oid 762235184, see above for details
15:54:27.106 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:54:27.106 4929 ERROR [SQLite 5] database is locked
15:54:27.106 4929 ERROR Failed to execute SQLite query, see above for details
15:54:27.106 4929 ERROR Failed to copy data for table with oid 1020924441 and part number 0, see above for details
15:54:32.432 4939 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:54:32.432 4939 ERROR [SQLite 5] database is locked
15:54:32.432 4939 ERROR Failed to execute SQLite query, see above for details
15:54:32.432 4939 ERROR Failed to track progress in our catalogs, see above for details
15:54:32.432 4939 ERROR Failed to create index with oid 990956499, see above for details
15:54:37.581 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:54:37.581 4929 ERROR [SQLite 5] database is locked
15:54:37.581 4929 ERROR Failed to execute SQLite query, see above for details
15:54:37.581 4929 ERROR Failed to copy data for table with oid 1036678948 and part number 0, see above for details
15:54:42.818 4938 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:54:42.819 4938 ERROR [SQLite 5] database is locked
15:54:42.819 4938 ERROR Failed to execute SQLite query, see above for details
15:54:42.819 4938 ERROR Failed to track progress in our catalogs, see above for details
15:54:42.819 4938 ERROR Failed to create index with oid 1030364680, see above for details
15:54:47.947 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:54:47.947 4929 ERROR [SQLite 5] database is locked
15:54:47.947 4929 ERROR Failed to execute SQLite query, see above for details
15:54:47.947 4929 ERROR Failed to copy data for table with oid 1173979337 and part number 0, see above for details
15:54:53.058 4938 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:54:53.058 4938 ERROR [SQLite 5] database is locked
15:54:53.058 4938 ERROR Failed to execute SQLite query, see above for details
15:54:53.058 4938 ERROR Failed to track progress in our catalogs, see above for details
15:54:53.058 4938 ERROR Failed to create index with oid 1038733569, see above for details
15:54:58.291 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:54:58.291 4929 ERROR [SQLite 5] database is locked
15:54:58.291 4929 ERROR Failed to execute SQLite query, see above for details
15:54:58.291 4929 ERROR Failed to copy data for table with oid 1262179280 and part number 0, see above for details
15:55:03.396 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:55:03.396 4937 ERROR [SQLite 5] database is locked
15:55:03.396 4937 ERROR Failed to execute SQLite query, see above for details
15:55:03.396 4937 ERROR Failed to track progress in our catalogs, see above for details
15:55:03.396 4937 ERROR Failed to create index with oid 1178354162, see above for details
15:55:08.451 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:55:08.451 4929 ERROR [SQLite 5] database is locked
15:55:08.451 4929 ERROR Failed to execute SQLite query, see above for details
15:55:08.451 4929 ERROR Failed to copy data for table with oid 1409114886 and part number 0, see above for details
15:55:13.758 4939 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:55:13.758 4939 ERROR [SQLite 5] database is locked
15:55:13.758 4939 ERROR Failed to execute SQLite query, see above for details
15:55:13.758 4939 ERROR Failed to track progress in our catalogs, see above for details
15:55:13.759 4939 ERROR Failed to create index with oid 1303293742, see above for details
15:55:19.064 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:55:19.064 4929 ERROR [SQLite 5] database is locked
15:55:19.064 4929 ERROR Failed to execute SQLite query, see above for details
15:55:19.064 4929 ERROR Failed to copy data for table with oid 2066245741 and part number 0, see above for details
15:55:24.113 4939 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:55:24.113 4939 ERROR [SQLite 5] database is locked
15:55:24.113 4939 ERROR Failed to execute SQLite query, see above for details
15:55:24.113 4939 ERROR Failed to track progress in our catalogs, see above for details
15:55:24.113 4939 ERROR Failed to create index with oid 2066245724, see above for details
15:55:29.160 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:55:29.160 4929 ERROR [SQLite 5] database is locked
15:55:29.160 4929 ERROR Failed to execute SQLite query, see above for details
15:55:29.160 4929 ERROR Failed to copy data for table with oid 2066305436 and part number 0, see above for details
15:55:34.175 4938 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:55:34.175 4938 ERROR [SQLite 5] database is locked
15:55:34.175 4938 ERROR Failed to execute SQLite query, see above for details
15:55:34.175 4938 ERROR Failed to track progress in our catalogs, see above for details
15:55:34.175 4938 ERROR Failed to create index with oid 2066245764, see above for details
15:55:39.375 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:55:39.375 4929 ERROR [SQLite 5] database is locked
15:55:39.375 4929 ERROR Failed to execute SQLite query, see above for details
15:55:39.375 4929 ERROR Failed to copy data for table with oid 2878626756 and part number 0, see above for details
15:55:44.473 4939 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:55:44.473 4939 ERROR [SQLite 5] database is locked
15:55:44.473 4939 ERROR Failed to execute SQLite query, see above for details
15:55:44.473 4939 ERROR Failed to track progress in our catalogs, see above for details
15:55:44.473 4939 ERROR Failed to create index with oid 2066305652, see above for details
15:55:49.482 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:55:49.482 4929 ERROR [SQLite 5] database is locked
15:55:49.482 4929 ERROR Failed to execute SQLite query, see above for details
15:55:49.482 4929 ERROR Failed to copy data for table with oid 3187055612 and part number 0, see above for details
15:55:54.609 4938 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:55:54.609 4938 ERROR [SQLite 5] database is locked
15:55:54.609 4938 ERROR Failed to execute SQLite query, see above for details
15:55:54.609 4938 ERROR Failed to track progress in our catalogs, see above for details
15:55:54.609 4938 ERROR Failed to create index with oid 3147581148, see above for details
15:55:59.655 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:55:59.655 4929 ERROR [SQLite 5] database is locked
15:55:59.655 4929 ERROR Failed to execute SQLite query, see above for details
15:55:59.655 4929 ERROR Failed to copy data for table with oid 3187056509 and part number 0, see above for details
15:56:04.871 4939 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:56:04.871 4939 ERROR [SQLite 5] database is locked
15:56:04.871 4939 ERROR Failed to execute SQLite query, see above for details
15:56:04.871 4939 ERROR Failed to track progress in our catalogs, see above for details
15:56:04.871 4939 ERROR Failed to create index with oid 3187056489, see above for details
15:56:09.891 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:56:09.891 4929 ERROR [SQLite 5] database is locked
15:56:09.892 4929 ERROR Failed to execute SQLite query, see above for details
15:56:09.892 4929 ERROR Failed to copy data for table with oid 3614060768 and part number 0, see above for details
15:56:15.245 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:56:15.245 4937 ERROR [SQLite 5] database is locked
15:56:15.245 4937 ERROR Failed to execute SQLite query, see above for details
15:56:15.245 4937 ERROR Failed to track progress in our catalogs, see above for details
15:56:15.245 4937 ERROR Failed to create index with oid 3187056557, see above for details
15:56:20.489 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:56:20.489 4929 ERROR [SQLite 5] database is locked
15:56:20.489 4929 ERROR Failed to execute SQLite query, see above for details
15:56:20.489 4929 ERROR Failed to copy data for table with oid 3615871294 and part number 0, see above for details
15:56:25.845 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:56:25.845 4937 ERROR [SQLite 5] database is locked
15:56:25.845 4937 ERROR Failed to execute SQLite query, see above for details
15:56:25.845 4937 ERROR Failed to track progress in our catalogs, see above for details
15:56:25.845 4937 ERROR Failed to create index with oid 3615871293, see above for details
15:56:31.170 4938 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:56:31.170 4938 ERROR [SQLite 5] database is locked
15:56:31.170 4938 ERROR Failed to execute SQLite query, see above for details
15:56:31.170 4938 ERROR Failed to track progress in our catalogs, see above for details
15:56:31.170 4938 ERROR Failed to create index with oid 3615871177, see above for details
15:56:36.495 4940 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:56:36.495 4940 ERROR [SQLite 5] database is locked
15:56:36.495 4940 ERROR Failed to execute SQLite query, see above for details
15:56:36.495 4940 ERROR Failed to track progress in our catalogs, see above for details
15:56:36.495 4940 ERROR Failed to create index with oid 3615871301, see above for details
15:56:41.564 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:56:41.564 4929 ERROR [SQLite 5] database is locked
15:56:41.564 4929 ERROR Failed to execute SQLite query, see above for details
15:56:41.564 4929 ERROR Failed to copy data for table with oid 92439514 and part number 0, see above for details
15:56:46.635 4940 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:56:46.635 4940 ERROR [SQLite 5] database is locked
15:56:46.635 4940 ERROR Failed to execute SQLite query, see above for details
15:56:46.635 4940 ERROR Failed to track progress in our catalogs, see above for details
15:56:46.635 4940 ERROR Failed to create index with oid 92439508, see above for details
15:56:51.847 4938 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:56:51.847 4938 ERROR [SQLite 5] database is locked
15:56:51.847 4938 ERROR Failed to execute SQLite query, see above for details
15:56:51.847 4938 ERROR Failed to track progress in our catalogs, see above for details
15:56:51.847 4938 ERROR Failed to create index with oid 2031120362, see above for details
15:56:57.194 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:56:57.194 4929 ERROR [SQLite 5] database is locked
15:56:57.194 4929 ERROR Failed to execute SQLite query, see above for details
15:56:57.194 4929 ERROR Failed to copy data for table with oid 92439570 and part number 0, see above for details
15:57:02.375 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:57:02.375 4937 ERROR [SQLite 5] database is locked
15:57:02.375 4937 ERROR Failed to execute SQLite query, see above for details
15:57:02.375 4937 ERROR Failed to track progress in our catalogs, see above for details
15:57:02.376 4937 ERROR Failed to create index with oid 2031120366, see above for details
15:57:07.714 4940 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:57:07.714 4940 ERROR [SQLite 5] database is locked
15:57:07.714 4940 ERROR Failed to execute SQLite query, see above for details
15:57:07.714 4940 ERROR Failed to track progress in our catalogs, see above for details
15:57:07.714 4940 ERROR Failed to create index with oid 92439545, see above for details
15:57:12.870 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:57:12.870 4929 ERROR [SQLite 5] database is locked
15:57:12.870 4929 ERROR Failed to execute SQLite query, see above for details
15:57:12.870 4929 ERROR Failed to copy data for table with oid 92439621 and part number 0, see above for details
15:57:18.181 4940 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:57:18.181 4940 ERROR [SQLite 5] database is locked
15:57:18.181 4940 ERROR Failed to execute SQLite query, see above for details
15:57:18.181 4940 ERROR Failed to track progress in our catalogs, see above for details
15:57:18.181 4940 ERROR Failed to create index with oid 92439591, see above for details
15:57:23.382 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:57:23.382 4929 ERROR [SQLite 5] database is locked
15:57:23.382 4929 ERROR Failed to execute SQLite query, see above for details
15:57:23.383 4929 ERROR Failed to copy data for table with oid 92440031 and part number 0, see above for details
15:57:28.517 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:57:28.517 4937 ERROR [SQLite 5] database is locked
15:57:28.517 4937 ERROR Failed to execute SQLite query, see above for details
15:57:28.517 4937 ERROR Failed to track progress in our catalogs, see above for details
15:57:28.517 4937 ERROR Failed to create index with oid 92439694, see above for details
15:57:33.859 4929 ERROR Failed to execute statement: insert into summary(pid, tableoid, partnum, start_time_epoch, command)values($1, $2, $3, $4, $5)
15:57:33.859 4929 ERROR [SQLite 5] database is locked
15:57:33.859 4929 ERROR Failed to execute SQLite query, see above for details
15:57:33.859 4929 ERROR Failed to copy data for table with oid 708167996 and part number 0, see above for details
15:57:39.020 4937 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:57:39.020 4937 ERROR [SQLite 5] database is locked
15:57:39.020 4937 ERROR Failed to execute SQLite query, see above for details
15:57:39.020 4937 ERROR Failed to track progress in our catalogs, see above for details
15:57:39.020 4937 ERROR Failed to create index with oid 708167970, see above for details
15:57:44.215 4940 ERROR Failed to execute statement: insert or replace into process( pid, ps_type, ps_title, tableoid, partnum, indexoid)values($1, $2, $3, $4, $5, $6)
15:57:44.215 4940 ERROR [SQLite 5] database is locked
15:57:44.215 4940 ERROR Failed to execute SQLite query, see above for details
15:57:44.215 4940 ERROR Failed to track progress in our catalogs, see above for details
15:57:44.215 4940 ERROR Failed to create index with oid 708167968, see above for details
15:57:44.268 4924 ERROR Some COPY worker process(es) have exited with error, see above for details
15:57:44.268 4924 ERROR Failed to copy table data, see above for details
15:57:44.286 4939 ERROR CREATE INDEX worker 4939 encountered 6 errors, see above for details
15:57:44.290 4937 ERROR CREATE INDEX worker 4937 encountered 13 errors, see above for details
15:57:44.297 4910 ERROR Sub-process 4924 exited with code 12
15:57:44.298 4932 ERROR VACUUM worker 4932 encountered 1 errors, see above for details
15:57:44.322 4938 ERROR CREATE INDEX worker 4938 encountered 9 errors, see above for details
15:57:44.327 4940 ERROR CREATE INDEX worker 4940 encountered 9 errors, see above for details
15:57:44.368 4927 ERROR Sub-process 4932 exited with code 12
15:57:44.368 4927 ERROR Some INDEX worker process(es) have exited with error, see above for details
15:57:44.368 4927 ERROR Failed to create indexes, see above for details
15:57:44.376 4925 ERROR Sub-process 4937 exited with code 12
15:57:44.376 4925 ERROR Sub-process 4938 exited with code 12
15:57:44.376 4925 ERROR Sub-process 4939 exited with code 12
15:57:44.376 4925 ERROR Sub-process 4940 exited with code 12
15:57:44.376 4925 ERROR Some INDEX worker process(es) have exited with error, see above for details
15:57:44.376 4925 ERROR Failed to create indexes, see above for details
15:57:44.397 4910 ERROR Sub-process 4925 exited with code 12
15:57:44.397 4910 ERROR Sub-process 4927 exited with code 12
15:57:44.397 4910 ERROR Some sub-processes have exited with error status, see above for details
15:57:44.397 4910 ERROR Errors detected, see above for details
15:57:44.397 4910 FATAL Failed to COPY the data, see above for details
15:57:44.397 4910 ERROR Failed to clone source database, see above for details
15:57:44.400 4908 ERROR clone process 4910 has terminated [6]
ubuntu@ip-10-230-167-20:~$
This looks like a malloc() problem and I believe by using a Garbage Collector as we do now we should be okay. Please try with the current sources of pgcopydb, building from sources, or wait until v0.16 which is soon to be released. Meanwhile I'm closing that issue for triaging purposes. Consider opening again with more information if more work is needed.