flink icon indicating copy to clipboard operation
flink copied to clipboard

[FLINK-27857][hive] HiveSource supports filter push down for orc format

Open luoyuxia opened this issue 3 years ago • 1 comments

What is the purpose of the change

Make hive source support filter push down for orc format

Brief change log

  • Make HiveTableSource implement SupportsFilterPushDown
  • Pass the OrcFilter to ORCRowInputFormat

Verifying this change

This change is a trivial rework without any test coverage.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
  • The S3 file system connector: no

Documentation

  • Does this pull request introduce a new feature? no
  • If yes, how is the feature documented? N/A

luoyuxia avatar Jun 18 '22 09:06 luoyuxia

CI report:

  • 2e54c78ba4e047526019940e7abd31a377bf7d55 Azure: FAILURE
Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

flinkbot avatar Jun 18 '22 09:06 flinkbot

@luoyuxia Can you help rebase the latest master branch?

lsyldliu avatar Oct 13 '22 01:10 lsyldliu