benraha

Results 11 comments of benraha

Spare not needed groupBy when calling toFragments() on AlignmentDataset

@heuermh Would love your thoughts on that before I implement it.

Spare not needed groupBy when calling toFragments() on AlignmentDataset

These are good, but I want to use the knowledge ADAM already has on the data instead of relying on the user to know it, or maybe there's some problem...

Added an optimisation to spare not required shuffle of unpaired reads

Jenkins, test this please

Added an optimisation to spare not required shuffle of unpaired reads

@heuermh Thanks! The tests should pass now, I'm ready to review and merge :)

Added an optimisation to spare not required shuffle of unpaired reads

Jenkins, test this please

Added an optimisation to spare not required shuffle of unpaired reads

Jenkins, test this please

Added an optimisation to spare not required shuffle of unpaired reads

There seems to be some kind of issue unpacking the hadoop tar gz https://amplab.cs.berkeley.edu/jenkins/job/ADAM-prb/3135/HADOOP_VERSION=2.7.5,SCALA_VERSION=2.12,SPARK_VERSION=2.4.7,label=ubuntu/console

Added an optimisation to spare not required shuffle of unpaired reads

Jenkins, test this please

Added an optimisation to spare not required shuffle of unpaired reads

Jenkins, test this please

Added an optimisation to spare not required shuffle of unpaired reads

Jenkins, test this please