bitsail icon indicating copy to clipboard operation
bitsail copied to clipboard
verified publisher icon bytedance

[BitSail][Connector] Support PB format serializer in Kafka Source

Open garyli1019 opened this issue 3 years ago • 2 comments

Is your feature request related to a problem? Please describe

Currently, kafka legacy source only support JSON format and we want to support PB format.

Describe the solution you'd like

we need to move com.bytedance.bitsail.dump.datasink.file.parser.PbBytesParser to a common place and reuse by other connector, such as kafka source

Describe alternatives you've considered

Additional context

garyli1019 avatar Nov 08 '22 12:11 garyli1019

Hi, can you assign this issue to me and help review this PR: https://github.com/bytedance/bitsail/pull/185

Best

qidian99 avatar Nov 17 '22 18:11 qidian99

sure, will take a look at the PR

garyli1019 avatar Nov 18 '22 01:11 garyli1019