custodian icon indicating copy to clipboard operation
custodian copied to clipboard

UnicodeDecode error parsing successful VASP job

Open Youjin1985 opened this issue 3 years ago • 1 comments

When reporting bugs/issues, please supply the following information. If this is a feature request, please simply state the requested feature.

System

  • Custodian version: 2022.2.13
  • Python version: 3.7.10
  • OS version: CentOS Linux release 7.4.1708

Summary

I launch vasp calculation with help of fireworks in offline mode on our group cluster. (Nodes cannot make network connections so online node is not an option). When fireworks tries to retrieve status of completed job (after lpad recover_offline), it fails because custodian cannot decode something:

Error message

Traceback (most recent call last): File "/public/home/evgenii/.virtualenvs/science/lib/python3.7/site-packages/fireworks/core/rocket.py", line 261, in run m_action = t.run_task(my_spec) File "/public/home/evgenii/.virtualenvs/science/lib/python3.7/site-packages/atomate/vasp/firetasks/run_calc.py", line 300, in run_task stored_custodian_data = {"custodian": json.load(f)} File "/public/home/evgenii/miniconda3/lib/python3.7/json/init.py", line 293, in load return loads(fp.read(), File "/public/home/evgenii/miniconda3/lib/python3.7/codecs.py", line 322, in decode (result, consumed) = self._buffer_decode(data, self.errors, final) UnicodeDecodeError: 'utf-8' codec can't decode byte 0x8b in position 1: invalid start byte

Files

custodian_error.tar.gz

In attached archive there is fireworks output of job. You can see that vasp job was competed successfully. Error message above is in FW_offline.json.gz.

Youjin1985 avatar May 12 '22 04:05 Youjin1985

I edited line 172, modifying RunVaspCustodian class atomate/vasp/firetasks/run_calc.py and made default gzipping False: gzip_output = self.get("gzip_output", False) This make my jobs status display as complete successfully So problem is with gzipping

Youjin1985 avatar May 12 '22 10:05 Youjin1985