Mahmoud Parsian

icon indicating a website link http://www.mapreduce4hackers.com icon indicating an email [email protected]

icon location Mahmoud Parsian, Ph.D. in computer science, is a software architect and author. He leads Illumina's Big Data team focused on large-scale genome analytics.

Results 11 comments of Mahmoud Parsian

Chapter 13, Use CombineByKey to Replace groupByKey and mapValues.

will look into this soon., thanks.

FastaRecordReader for huge fasta files

Hello Jose, I will look into this and test it with your input. Thanks, best regards, Mahmoud

API out of date

I will look into this issue and post my findings. Thanks, Mahmoud

API out of date

Upgraded to Spark-2.3.0 & fixed ClientArguments. Please let me know if there any issue. Thanks, Mahmoud

Second Edition

Dear Yasmin, I am working on a proposal to publish it with O’Reilly: this might take 12+ months. Thank you for your interest, If I can be any help, please...

Second Edition

Hello, the second edition of Data Algorithms will be called "Data Algorithms with Spark” and will be published by O’Reilly on 2021. Thank you. Mahmoud > On Apr 7, 2020,...

Code uses yarn private classes so cannot compile

I am using the built single jar (by SBT) : spark-assembly-1.6.1-hadoop2.6.0.jar, which compiles and runs. When I examine the source code for ClientArguments in NetBeans IDE, I see the following:...

Hi am facing an issue with submit a job from java.

Please provide more details: your script, its log and error messages.

Hi am facing an issue with submit a job from java.

Can you also please include error messages you are getting? If possible, include your Scala classes (all of your classes) as well so that I can try it on my...

Issue submitting Spark Job from code when Spark Job is a Python program.

Hello Scott, Thank you very much for your email and introduction. I am not an expert in python, but I want to take a look at your python program, please...