starrocks icon indicating copy to clipboard operation
starrocks copied to clipboard

Published 20 hours ago • verified publisher icon StarRocks

[Feature] Add a case sensitive flag to hdfs scan node to indicate whether the hive table column names are case sensitive or not

Open GavinMar opened this issue 2 years ago • 4 comments

What type of PR is this：

  • [ ] bug
  • [x] feature
  • [ ] enhancement
  • [ ] refactor
  • [ ] others

Which issues of this PR fixes ：

Fixes #

Problem Summary(Required) ：

By default, presto/hive/impala are column name case sensitive. But spark and iceberg can be configured to be column name case sensitive or not. So when reading extern tables from different data source, we need to know whether the column name are case sensitive, if not, we should match the column names ignoring case.

Checklist:

  • [x] I have added test cases for my bug fix or my new feature
  • [ ] I have added user document for my new feature or new function

GavinMar avatar Aug 09 '22 02:08 GavinMar

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

sonarqubecloud[bot] avatar Aug 10 '22 12:08 sonarqubecloud[bot]

[FE PR Coverage Check]

:heart_eyes: pass : 0 / 0 (0%)

wanpengfei-git avatar Aug 10 '22 12:08 wanpengfei-git

run starrocks_admit_test

GavinMar avatar Aug 11 '22 13:08 GavinMar

run starrocks_admit_test

GavinMar avatar Aug 12 '22 02:08 GavinMar

should support text scanner too.

DorianZheng avatar Aug 16 '22 06:08 DorianZheng

run starrocks_admit_test

wanpengfei-git avatar Aug 16 '22 06:08 wanpengfei-git

run starrocks_admit_test

GavinMar avatar Aug 16 '22 08:08 GavinMar

should support text scanner too.

OK, I'll add this to text scanner in another PR.

GavinMar avatar Aug 16 '22 14:08 GavinMar