pentaho-kettle icon indicating copy to clipboard operation
pentaho-kettle copied to clipboard

[PDI-19719] - PGBulkLoader failed if input stream is empty

Open petrprochy opened this issue 2 years ago • 12 comments

JIRA: https://jira.pentaho.com/browse/PDI-19719

petrprochy avatar Jan 31 '23 10:01 petrprochy

:white_check_mark: Build finished in 7m 39s

Build command:

mvn clean verify -B -e -Daudit -amd -pl \
plugins/postgresql-db-bulk-loader/impl

:ok_hand: All tests passed!

Tests run: 12, Failures: 0, Skipped: 0    Test Results


:information_source: This is an automatic message

buildguy avatar Jan 31 '23 10:01 buildguy

:white_check_mark: Build finished in 7m 28s

Build command:

mvn clean verify -B -e -Daudit -amd -pl \
plugins/postgresql-db-bulk-loader/impl

:ok_hand: All tests passed!

Tests run: 13, Failures: 0, Skipped: 0    Test Results


:information_source: This is an automatic message

buildguy avatar Feb 10 '23 11:02 buildguy

SonarQube Quality Gate

Quality Gate failed

Failed condition 50.0% 50.0% Coverage on New Code (is less than 80%)

See analysis details on SonarQube

While migrating the table data thru kettle tool from sql server to postgresql database getting below-

2023/03/15 16:59:52 - write to [REPORTS].0 - Caused by: org.postgresql.util.PSQLException: ERROR: column "NAME" of relation "reports" does not exist Position: 56

SQL Server table ddl-

CREATE TABLE [dbo].[REPORTS]( [RID] [int] NOT NULL, [NAME] nvarchar NULL, [CATEGORY] [int] NULL, [STATUS] [int] NULL, [XML] nvarchar NULL, [DESCRIPTION] nvarchar NULL)

Postgresql table ddl -

CREATE TABLE IF NOT EXISTS public.reports ( rid integer NOT NULL, name character varying(150), category integer, status integer, xml character varying, description character varying(255) )

arunchugh87 avatar Mar 15 '23 18:03 arunchugh87

This is not good place for resolving of this problem. Please use official Pentaho community forum.

petrprochy avatar Mar 17 '23 15:03 petrprochy

Hi, I tried but do not have the access. View only I can.

On Fri, Mar 17, 2023, 20:31 Petr Procházka @.***> wrote:

This is not good place for resolving of this problem. Please use official Pentaho community forum https://community.hitachivantara.com/communities/community-pentaho-home?CommunityKey=e0eaa1d8-5ecc-4721-a6a7-75d4e890ee0d .

— Reply to this email directly, view it on GitHub https://github.com/pentaho/pentaho-kettle/pull/8791#issuecomment-1473977035, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6QNFPVWHVCD6DZ5DTUAPVDW4R4F3ANCNFSM6AAAAAAUMHHHPI . You are receiving this because you commented.Message ID: @.***>

arunchugh87 avatar Mar 17 '23 15:03 arunchugh87

Hi, is there any chance i could get these changes in a new .jar file for my project? I encountered this problem and it's really frustrating and there is only this fix available. I tried to recompile it and generate new .class files but it just doesn't work. It's used in PDI in plugins/postgresql-db-bulk-loader-plugins and there are two .jar files: postgresql-db-bulk-loader-plugins-impl-9.4.0.0-343.jar and postgresql-db-bulk-loader-plugins-ui-9.4.0.0-343.jar . I suppose this fix is relevant only to the first .jar file. Thanks for help in advance.

marhefkaadam avatar Mar 19 '23 19:03 marhefkaadam

@arunchugh87 At the top right is Sign In and bottom of page is link Register Here (for partners, customers and guests).

petrprochy avatar Mar 20 '23 17:03 petrprochy

@marhefkaadam You can clone from my repository and use branch 9.4.0.0-GA with this fix. You need Maven v3.8 (do not use Maven v3.9) and run building of project: mvn package. Or download my last integration ZIP of plugin postgresql-db-bulk-loader-plugins-9.4.0.0-343-1-20230301.151900-4.zip

petrprochy avatar Mar 20 '23 17:03 petrprochy

@petrprochy thanks for the help! I managed to recompile it on my machine with your fix in the end. But thanks!

marhefkaadam avatar Mar 21 '23 21:03 marhefkaadam

@marhefkaadam You can clone from my repository and use branch 9.4.0.0-GA with this fix. You need Maven v3.8 (do not use Maven v3.9) and run building of project: mvn package. Or download my last integration ZIP of plugin postgresql-db-bulk-loader-plugins-9.4.0.0-343-1-20230301.151900-4.zip

thanks so much, my pgbulkloaders stopped working when upgrading to pdi 9.4, and those plugins did the trick to make it back to work

jpturski avatar Jan 25 '24 13:01 jpturski

:x: Build failed in 5m 2s

Build command:

mvn clean verify -B -e -Daudit -amd -Djs.no.sandbox -pl \
plugins/postgresql-db-bulk-loader/impl

:exclamation: No tests found!

Errors:

Filtered log (click to expand)

script returned exit code 1

:information_source: This is an automatic message

buildguy avatar Mar 04 '24 10:03 buildguy