dolphinscheduler icon indicating copy to clipboard operation
dolphinscheduler copied to clipboard

[Bug] [DataX] If the reader is oracle, there is a problem with the ***columns*** field of the generated dataxjson

Open fuchanghai opened this issue 3 years ago • 2 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

The columns fields are all uppercase, causing some databases to fail to import

企业微信截图_321836cd-3e37-43b4-addb-c7397ff39137

What you expected to happen

  • if reader is oracle lowercase column names
  • if writer is oracle capitalize column names

How to reproduce

  • if reader is oracle lowercase column names
  • if writer is oracle capitalize column names

Anything else

No response

Version

3.0.0

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

fuchanghai avatar Aug 11 '22 07:08 fuchanghai

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

The columns fields are all uppercase, causing some databases to fail to import

企业微信截图_321836cd-3e37-43b4-addb-c7397ff39137

What you expected to happen

  • if reader is oracle lowercase column names
  • if writer is oracle capitalize column names

How to reproduce

  • if reader is oracle lowercase column names
  • if writer is oracle capitalize column names

Anything else

No response

Version

3.0.0

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

Code of Conduct

github-actions[bot] avatar Aug 11 '22 07:08 github-actions[bot]

Thank you for your feedback, we have received your issue, Please wait patiently for a reply.

  • In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
  • If you haven't received a reply for a long time, you can join our slack and send your question to channel #troubleshooting

github-actions[bot] avatar Aug 11 '22 07:08 github-actions[bot]

@SbloodyS i had test again ,the cause of things is not oracle field capitalization. My target database is CLICKHOUSE , it is case sensitive, and in this example its column names are lowercase fields。so it leads to the problem of not being able to import.

We need to add a parameter to indicate whether the fields in the datax json should be converted to lowercase or uppercase? which can solve some databases that is case sensitive (if we use 'select *' will occur )

fuchanghai avatar Aug 13 '22 01:08 fuchanghai

cc @ruanwenjun plz take a look

fuchanghai avatar Aug 13 '22 01:08 fuchanghai