dataproc-templates
dataproc-templates copied to clipboard
[notebook] [bug] Hardcoded WORKING_DIRECTORY
All notebooks have hardcoded working directory. It needs to be dynamically computed as user can potentially checkout in a different sub-directory.
I have created the PR for this issue . It solves the basic problem of hardcoded working directory however for cases where notebooks are run on spark cluster rather than locally , we still need to specify the path manually.
Kindly refer to PR comments for more details