adam icon indicating copy to clipboard operation
adam copied to clipboard

Pipe API without expectation that return value is GenomicRDD

Open heuermh opened this issue 7 years ago • 5 comments

heuermh avatar Oct 30 '17 19:10 heuermh

What's the use case? Its hard to understand what this means without a usage example.

fnothaft avatar Oct 30 '17 19:10 fnothaft

Streaming out to external applications via one of the ADAM formats Formatters but streaming back into non-Genomic RDD or Dataset/DataFrame, say generic text/csv/etc.

heuermh avatar Oct 30 '17 19:10 heuermh

Ah, I see. Would the return type be RDD[String] and each record would be a line?

fnothaft avatar Oct 30 '17 19:10 fnothaft

Would the return type be RDD[String] and each record would be a line?

Yes, I believe that would be sufficient.

heuermh avatar Nov 21 '17 16:11 heuermh

Do you want to take this for 0.25.0? I would imagine the converse RDD[String] => GenomicRDD could be valuable as well.

fnothaft avatar Jan 21 '18 22:01 fnothaft