mango
mango copied to clipboard
bigdatagenomics
Error getting after build Success
Hi, I had successfully build Mango. But I am having the following error while running ./mango-submit 👍
[rokshan.jahan@ip-10-48-3-63 bin]$ ./mango-submit
Using SPARK_SUBMIT=/usr/bin/spark-submit
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/parquet/hadoop/metadata/CompressionCodecName
at org.bdgenomics.utils.cli.ParquetArgs$class.$init$(ParquetArgs.scala:40)
at org.bdgenomics.mango.cli.VizReadsArgs.
This looks like https://github.com/bigdatagenomics/adam/issues/1742. What spark/scala version are you running?
Spark 1.6.3
On Thu, Oct 5, 2017 at 9:02 PM akmorrow13 [email protected] wrote:
This looks like bigdatagenomics/adam#1742 https://github.com/bigdatagenomics/adam/issues/1742. What spark/scala version are you running?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/bigdatagenomics/mango/issues/320#issuecomment-334632208, or mute the thread https://github.com/notifications/unsubscribe-auth/AcIGPTKMdzk7amU37TVwfINKel5hScXVks5spXwpgaJpZM4Pvem8 .
-- Have a Blessed Day! Sincerely, Rokshan A Jahan
Using spark-1.6.3-bin-hadoop2.6, I am not able to reproduce this issue. Have you built Mango for Spark 2?
No , I don’t have spark 2. Is it necessary ? Can’t mango work on spark 1.6?
On Thu, Oct 5, 2017 at 9:09 PM akmorrow13 [email protected] wrote:
Using spark-1.6.3-bin-hadoop2.6, I am not able to reproduce this issue. Have you built Mango for Spark 2?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/bigdatagenomics/mango/issues/320#issuecomment-334633018, or mute the thread https://github.com/notifications/unsubscribe-auth/AcIGPSVQXXnvf2ssAHeui2FAurk0Xc_Rks5spX3AgaJpZM4Pvem8 .
-- Have a Blessed Day! Sincerely, Rokshan A Jahan
Mango should run on spark 1 and 2. This error can appear if Mango is compiled for Spark 2 but you are running on Spark 1.6.3. However, I cannot reproduce this error with Spark 1.6.3, where /bin/mango-submit does not throw an error. Can you print out spark_home, scala version, and verify mango is packaged for spark 1?
Ok, will do that
On Thu, Oct 5, 2017 at 9:19 PM akmorrow13 [email protected] wrote:
Mango should run on spark 1 and 2. This error can appear if Mango is compiled for Spark 2 but you are running on Spark 1.6.3. However, I cannot reproduce this error with Spark 1.6.3, where /bin/mango-submit does not throw an error. Can you print out spark_home, scala version, and verify mango is packaged for spark 1?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/bigdatagenomics/mango/issues/320#issuecomment-334634194, or mute the thread https://github.com/notifications/unsubscribe-auth/AcIGPSbbpMXoxprJVKjyd44rRs1n9x04ks5spYASgaJpZM4Pvem8 .
-- Have a Blessed Day! Sincerely, Rokshan A Jahan