OpenMetadata icon indicating copy to clipboard operation
OpenMetadata copied to clipboard

IBM Db2 ingestion

Open elguero6 opened this issue 1 year ago • 3 comments

Affected module Ingestion Framework

Describe the bug When the DB2 Profiler Ingestion runs this error shows in the logs : String data right truncation. SQLSTATE=22001 SQLCODE=-99999 I believe the columnNames parameter is too long, if I run the query in a Database Client, it will run fine with fewer characters in the parameter

To Reproduce

Create a IBM DB2 Connection, run the profiler ingestion.

Expected behavior

sqlalchemy.exc.DataError: (ibm_db_dbi.DataError) ibm_db_dbi::DataError: Statement Execute Failed: [IBM][CLI Driver] CLI0109E String data right truncation. SQLSTATE=22001 SQLCODE=-99999 [SQL: /* {"app": "OpenMetadata", "version": "1.2.3.2"} / SELECT count() AS "rowCount", CAST(? AS BIGINT) AS "columnCount", CAST(? AS VARCHAR) AS "columnNames" FROM example_Schema.example_table FETCH FIRST 1 ROWS ONLY]

Version:

  • OS: Kubernetes
  • Python version:3.9
  • OpenMetadata version: 1.2.3
  • OpenMetadata Ingestion package version: 1.2.3

Additional context Add any other context about the problem here.

elguero6 avatar Jan 08 '24 21:01 elguero6

Hello @elguero6, I will take a look on the issue, you can track the progress here itself. You can check the project part to see which release it will be a part of, based on the bandwidth and priorities 🙏

ayush-shah avatar Jan 09 '24 07:01 ayush-shah

@elguero6 how many columns does your table have? The columnNames parameter will be replaced by a string of all your column (comma separated). We might need to specify a greater VARCHAR length.

TeddyCr avatar Jan 26 '24 16:01 TeddyCr

Yea can be numerous, 20-50 column table

elguero6 avatar Feb 15 '24 23:02 elguero6