spark-standalone-cluster-on-docker icon indicating copy to clipboard operation
spark-standalone-cluster-on-docker copied to clipboard

[FEATURE] Build images on Mac OSX (with solution)

Open alexeyegorov opened this issue 4 years ago • 3 comments

Building on Mac OSX

Description

I have tried to build your images on Mac OSX which failed as awaited, BUT it is pretty easy to solve and I was able to build everything locally. 👍

The problem with the original shell script and Mac OSX is that Apple has BSD grep preinstalled in contrast to GNU grep. On Mac OSX one can simply install GNU grep with Homebrew:

brew install grep

Afterwards, one can set grep to the PATH variable, while this might change some system behaviour. I have changed locally all grep calls in the script with ggrep and it all worked. This might be possible to be interchangeable by setting the command as variable (e.g. in build.yml?). Then the build script should work on Linux and Mac OSX.

alexeyegorov avatar Nov 10 '20 10:11 alexeyegorov

Hi @alexeyegorov, the solution proposed on #42 looks pretty simple indeed! I am figuring out how to test on my Linux machine and I will let you know. Any ideas?

andre-marcos-perez avatar Dec 28 '20 22:12 andre-marcos-perez

Thanks for your reply. :) I can't help you with that. I can only admit that it works for me on my MacBook Pro 2019. Unfortunately, I don't know how you could test it on Linux. I can run Linux on MacOS, but I don't think it is possible the other way around. I record my screen and share it with you to prove that it is working. ;)

alexeyegorov avatar Jan 11 '21 11:01 alexeyegorov

An idea that came into my mind: is it possible to install BSD version of grep on Linux? This was at least one of the things that wasn't working on Mac as it has BSD version preinstalled.

alexeyegorov avatar Jan 13 '21 16:01 alexeyegorov