Add a simple split interceptor
a simple split interceptor , aims to deal with the situation as follows:
the source data like this: “ 1,tom,boy,13 2,lili,girl,14 3,jack,boy,10 ... ” and i hope to sink source data into two different hdfs directories named by boy and girl like this: “ hdfs://xxxx/sink/boy/.... hdfs://xxxx/sink/girl/.... ”
we can use this interceptor to accomplish this goal.
We don't accept pull requests. Could you please attach the patch to a jira here: https://issues.apache.org/jira/browse/FLUME ? Thanks!
@harishreedharan hi harishreedharan, i have created FLUME-2781 and attached the patch, is that ok? Thanks!
Yep, a committer will review he patch. Thanks @SeekerResource!
Hello - we are interested in this enhancement. Do you have a readme available? Has this been merged into a master version? The JIRA ticket FLUME-2781 does not refer to this issue. Thanks!
@lew181818 : what kind of readme are you looking for?
I don't think this has been merged yet.
Also, the corresponding JIRA ticket is https://issues.apache.org/jira/browse/FLUME-2807 , I believe.
@bessbd : For a readme, something simple like should we be using multiplexing source to direct the output into different sinks? Any other configuration to know to get this working in flume?
Thanks for the jira ticket.
@lew181818 : if you are only looking for a documentation on the configuration, maybe https://github.com/apache/flume/pull/14/files#diff-4d9ec6998a1233dda992589304f831d4R67 should help.
Please, let me know, if I misunderstood your request.
Btw, if there is demand for this PR to be merged, we can reboot the review process.
Can one of the admins verify this patch?