UnicodeDecode error parsing successful VASP job
When reporting bugs/issues, please supply the following information. If this is a feature request, please simply state the requested feature.
System
- Custodian version: 2022.2.13
- Python version: 3.7.10
- OS version: CentOS Linux release 7.4.1708
Summary
I launch vasp calculation with help of fireworks in offline mode on our group cluster. (Nodes cannot make network connections so online node is not an option). When fireworks tries to retrieve status of completed job (after lpad recover_offline), it fails because custodian cannot decode something:
Error message
Traceback (most recent call last): File "/public/home/evgenii/.virtualenvs/science/lib/python3.7/site-packages/fireworks/core/rocket.py", line 261, in run m_action = t.run_task(my_spec) File "/public/home/evgenii/.virtualenvs/science/lib/python3.7/site-packages/atomate/vasp/firetasks/run_calc.py", line 300, in run_task stored_custodian_data = {"custodian": json.load(f)} File "/public/home/evgenii/miniconda3/lib/python3.7/json/init.py", line 293, in load return loads(fp.read(), File "/public/home/evgenii/miniconda3/lib/python3.7/codecs.py", line 322, in decode (result, consumed) = self._buffer_decode(data, self.errors, final) UnicodeDecodeError: 'utf-8' codec can't decode byte 0x8b in position 1: invalid start byte
Files
In attached archive there is fireworks output of job. You can see that vasp job was competed successfully. Error message above is in FW_offline.json.gz.
I edited line 172, modifying RunVaspCustodian class atomate/vasp/firetasks/run_calc.py and made default gzipping False: gzip_output = self.get("gzip_output", False) This make my jobs status display as complete successfully So problem is with gzipping