roryk
CalledProcessError
with cluster_view(scheduler="slurm", queue="hsph", num_jobs=20) as view: view.map(time_waster, range(20))
CalledProcessError Traceback (most recent call last)
/share/PI/rondror/software/miniconda/lib/python2.7/contextlib.pyc in enter(self) 15 def enter(self): 16 try: ---> 17 return self.gen.next() 18 except StopIteration: 19 raise RuntimeError("generator didn't yield")
/home/thomklau/.local/lib/python2.7/site-packages/cluster_helper/cluster.pyc in cluster_view(scheduler, queue, num_jobs, cores_per_job, profile, start_wait, extra_params, retries, direct, wait_for_all_engines) 1103 profile=profile, start_wait=start_wait, extra_params=extra_params, 1104 retries=retries, direct=direct, -> 1105 wait_for_all_engines=wait_for_all_engines) 1106 try: 1107 yield cluster_view.view
/home/thomklau/.local/lib/python2.7/site-packages/cluster_helper/cluster.pyc in init(self, scheduler, queue, num_jobs, cores_per_job, profile, start_wait, extra_params, retries, direct, wait_for_all_engines) 971 if self.profile is None: 972 self.has_throwaway = True --> 973 self.profile = create_throwaway_profile() 974 else: 975 # ensure we have an .ipython directory to prevent issues
/home/thomklau/.local/lib/python2.7/site-packages/cluster_helper/cluster.pyc in create_throwaway_profile() 1169 cmd = [sys.executable, "-E", "-c", "from IPython import start_ipython; start_ipython()", 1170 "profile", "create", profile, "--parallel"] -> 1171 subprocess.check_call(cmd) 1172 return profile 1173
/share/PI/rondror/software/miniconda/lib/python2.7/subprocess.pyc in check_call(*popenargs, **kwargs) 538 if cmd is None: 539 cmd = popenargs[0] --> 540 raise CalledProcessError(retcode, cmd) 541 return 0 542
CalledProcessError: Command '['/share/PI/rondror/software/miniconda/bin/python', '-E', '-c', 'from IPython import start_ipython; start_ipython()', 'profile', 'create', '036ed3ce-159d-11e7-a1f1-40167e11fcaf', '--parallel']' returned non-zero exit status 1
Hi Thomas,
What does running
/share/PI/rondror/software/miniconda/bin/python -E -c 'from IPython import start_ipython; start_ipython()' profile create 036ed3ce-159d-11e7-a1f1-40167e11fcaf --parallel
return if you run it on the command line? I am guessing that there is a permissions issue or it otherwise can't create the temporary profile directory.
It looks fine:
[thomklau@gpu-9-8 ~]$ /share/PI/rondror/software/miniconda/bin/python -E -c 'from IPython import start_ipython; start_ipython()' profile create 036ed3ce-159d-11e7-a1f1-40167e11fcaf --parallel [ProfileCreate] Generating default config file: u'/home/thomklau/.ipython/profile_036ed3ce-159d-11e7-a1f1-40167e11fcaf/ipython_config.py' [ProfileCreate] Generating default config file: u'/home/thomklau/.ipython/profile_036ed3ce-159d-11e7-a1f1-40167e11fcaf/ipython_kernel_config.py' [ProfileCreate] Generating default config file: u'/home/thomklau/.ipython/profile_036ed3ce-159d-11e7-a1f1-40167e11fcaf/ipcontroller_config.py' [ProfileCreate] Generating default config file: u'/home/thomklau/.ipython/profile_036ed3ce-159d-11e7-a1f1-40167e11fcaf/ipengine_config.py' [ProfileCreate] Generating default config file: u'/home/thomklau/.ipython/profile_036ed3ce-159d-11e7-a1f1-40167e11fcaf/ipcluster_config.py'
Thomas Lau
On Thu, Mar 30, 2017 at 5:05 PM, Rory Kirchner [email protected] wrote:
Hi Thomas,
What does running
/share/PI/rondror/software/miniconda/bin/python -E -c 'from IPython import start_ipython; start_ipython()' profile create 036ed3ce-159d-11e7-a1f1-40167e11fcaf --parallel
return if you run it on the command line? I am guessing that there is a permissions issue or it otherwise can't create the temporary profile directory.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/roryk/ipython-cluster-helper/issues/49#issuecomment-290579227, or mute the thread https://github.com/notifications/unsubscribe-auth/ABnivQXnImCb33NwaaMAegiS1gbu7_wFks5rrEMsgaJpZM4MvB6Y .