Ryan Williams

Results 184 comments of Ryan Williams

[I think I have this working](https://github.com/hammerlab/guacamole/pull/564) in the repo @arahuja and I are concerned about, so we can probably close this. Either something was fixed here or in maven-coveralls-plugin in...

I should mention that, when GitX is struggling with Spark, the behavior that seems to be worse for my computer's usability than the CPU usage is the memory usage. In...

Interesting, I thought `time` was pretty standard in `bash` shells, which `scripts/guacamole`'s shebang line specifies. What shell are you using @car2008? Seems like we probably implicitly make stronger assumptions elsewhere...

Are you able to share that BAM with us, @car2008?

He mentioned above that it's a 7GB BAM; since that's compressed you could get arbitrary blow-up when reading the whole thing in, so not terribly surprising that it would blow...

You got it, `--bam-reader-api` is now gone, as of #569. Just leave that flag out altogether and you will be using Hadoop-BAM!

It looks to have failed due to a Kryo exception: ``` Caused by: com.esotericsoftware.kryo.KryoException: Encountered unregistered class ID: 4267 ``` I'm not sure otomh what would cause that, but have...

What version of Spark are you running on? (i.e. does `$SPARK_HOME` point to). The "managed memory leak detected", and logged at `Executor:74`, is suspicious to me (I don't see any...

Thanks for that info! Interesting that throwing more memory+cores (edit: it looks like you only used more memory, `10g` vs. `4g`, in the run that passed above; see [discussion below](https://github.com/hammerlab/guacamole/issues/572#issuecomment-248951729))....

Looking back at this, I noticed that, despite the machines being used having 10GB and 100GB of available memory (if I understand you correctly), your apps are running with `spark.driver.memory`...