ChemLLMBench
ChemLLMBench copied to clipboard
question about pipeline code &dataset
Hello, I am trying to test the performance of my model on chemllmbench, but I meet some issues as following:
- For property prediction tasks, there is a lack of code for calculating the AUC-ROC metric.
- For Name Prediction task, it seems that the previous dataset download location has become invalid. Could you help me resolve these issues?
- For Name Prediction task, the download link is updated and valid.
- For property prediction tasks, @KehanGuo2 can you help fix this issue?
With the "generated_p", which is "Yes"/"No", you can easily calculate the AUROC score