Evaluation metrics for the generation task

[ubikpt]

Sorry for bothering you with all these questions ...

As you know I didn't manage to execute the reconstruction task, but I think the generation task finished succefully. The program created a file called eval_gen.pt

However when I run:

python scripts/compute_metrics.py --root_path /home/CDVAE/cdvae-main/hydra/singlerun/2022-02-10/perov/ --tasks gen

I get the error:

FileNotFoundError: [Errno 2] No such file or directory: '/home/CDVAE/cdvae-main/hydra/singlerun/2022-02-10/perov/eval_recon.pt'

Does this mean the evaluation of the generation task is dependent on results of the reconstruction task ?

Luis

[txie-93]

Great question. Yes, it loads the test materials from eval_recon.py. The test materials are used to compute some metrics like coverage. The reconstructed materials are not used. This dependency is not necessary, but it saves the time by avoiding loading the test materials twice. I hope to rewrite this and load test materials from data file in the future.