htmap icon indicating copy to clipboard operation
htmap copied to clipboard

JobEventLog not initialized when running simple map

Open maxgalli opened this issue 3 years ago • 7 comments

Hi,

I'm tying to run the following very basic example:

import htmap

def double(x):
    return 2 * x

def main():
    doubled = list(htmap.map(double, range(10)))
    print(doubled)
                                                                                                                                                                                                                     
if __name__ == "__main__":
    main()

but I always get the following error:

Traceback (most recent call last):
  File "base.py", line 11, in <module>
    main()
  File "base.py", line 7, in main
    doubled = list(htmap.map(double, range(10)))
  File "/afs/cern.ch/work/g/gallim/anaconda3/envs/my_messy_root/lib/python3.7/site-packages/htmap/maps.py", line 413, in __iter__
    yield from self.iter()
  File "/afs/cern.ch/work/g/gallim/anaconda3/envs/my_messy_root/lib/python3.7/site-packages/htmap/maps.py", line 427, in iter
    yield self._load_output(component, timeout=timeout)
  File "/afs/cern.ch/work/g/gallim/anaconda3/envs/my_messy_root/lib/python3.7/site-packages/htmap/maps.py", line 342, in _load_output
    self._wait_for_component(component, timeout)
  File "/afs/cern.ch/work/g/gallim/anaconda3/envs/my_messy_root/lib/python3.7/site-packages/htmap/maps.py", line 298, in _wait_for_component
    component_status = self.component_statuses[component]
  File "/afs/cern.ch/work/g/gallim/anaconda3/envs/my_messy_root/lib/python3.7/site-packages/htmap/maps.py", line 561, in component_statuses
    return self._state.component_statuses
  File "/afs/cern.ch/work/g/gallim/anaconda3/envs/my_messy_root/lib/python3.7/site-packages/htmap/state.py", line 89, in component_statuses
    self._read_events()
  File "/afs/cern.ch/work/g/gallim/anaconda3/envs/my_messy_root/lib/python3.7/site-packages/htmap/state.py", line 115, in _read_events
    self._event_reader = htcondor.JobEventLog(self._event_log_path.as_posix()).events(0)
htcondor.HTCondorIOError: JobEventLog not initialized.  Check the debug log, looking for ReadUserLog or FileModifiedTrigger.  (Or call htcondor.enable_debug() and try again.)

The jobs seem to be submitted and kept on hold.

Do you know what the problem could be? If you think it is something related to the configuration of HTCondor itself on our batch system, do you have any suggestions of what I could possibly ask to the administrators? By looking at version packages there seem to be an inconsistency between the version of Condor (8.8.7) and the python bindings that I'm using (8.9.11). Do you think this might cause the problem?

Thank you,

Massimiliano

Software Versions:

$ python -c "import htcondor, htmap; print(htcondor.version()); print(htmap.version())"
$CondorVersion: 8.9.11 Jan 27 2021 BuildID: UW_Python_Wheel_Build $
HTMap version 0.6.1
$ condor_version
$CondorVersion: 8.8.7 Dec 24 2019 BuildID: 493225 PackageID: 8.8.7-1 $
$CondorPlatform: x86_64_RedHat7 $
$ cat /etc/os-release
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="http://cern.ch/linux/"
BUG_REPORT_URL="http://cern.ch/linux/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
$ cat /proc/version
Linux version 3.10.0-1160.11.1.el7.x86_64 ([email protected]) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) ) #1 SMP Fri Dec 18 16:34:56 UTC 2020

maxgalli avatar Feb 20 '21 21:02 maxgalli