logging-flume icon indicating copy to clipboard operation
logging-flume copied to clipboard

Add a simple split interceptor

Open seekingua opened this issue 10 years ago • 8 comments

a simple split interceptor , aims to deal with the situation as follows:

the source data like this: “ 1,tom,boy,13 2,lili,girl,14 3,jack,boy,10 ... ” and i hope to sink source data into two different hdfs directories named by boy and girl like this: “ hdfs://xxxx/sink/boy/.... hdfs://xxxx/sink/girl/.... ”

we can use this interceptor to accomplish this goal.

seekingua avatar Feb 26 '15 13:02 seekingua

We don't accept pull requests. Could you please attach the patch to a jira here: https://issues.apache.org/jira/browse/FLUME ? Thanks!

harishreedharan avatar Sep 02 '15 20:09 harishreedharan

@harishreedharan hi harishreedharan, i have created FLUME-2781 and attached the patch, is that ok? Thanks!

seekingua avatar Oct 04 '15 19:10 seekingua

Yep, a committer will review he patch. Thanks @SeekerResource!

harishreedharan avatar Oct 06 '15 03:10 harishreedharan

Hello - we are interested in this enhancement. Do you have a readme available? Has this been merged into a master version? The JIRA ticket FLUME-2781 does not refer to this issue. Thanks!

lew181818 avatar Nov 03 '16 19:11 lew181818

@lew181818 : what kind of readme are you looking for?

I don't think this has been merged yet.

Also, the corresponding JIRA ticket is https://issues.apache.org/jira/browse/FLUME-2807 , I believe.

bessbd avatar Nov 04 '16 10:11 bessbd

@bessbd : For a readme, something simple like should we be using multiplexing source to direct the output into different sinks? Any other configuration to know to get this working in flume?

Thanks for the jira ticket.

lew181818 avatar Nov 07 '16 14:11 lew181818

@lew181818 : if you are only looking for a documentation on the configuration, maybe https://github.com/apache/flume/pull/14/files#diff-4d9ec6998a1233dda992589304f831d4R67 should help.

Please, let me know, if I misunderstood your request.

Btw, if there is demand for this PR to be merged, we can reboot the review process.

bessbd avatar Nov 07 '16 15:11 bessbd

Can one of the admins verify this patch?

asfgit avatar Aug 17 '18 13:08 asfgit