BY571

Discrepancy in ChemBench Score for google/gemma-2-9b-it (0.13 vs Expected 0.48)

3

Hello, I'm attempting to reproduce the reported ChemBench results for the google/gemma-2-9b-it model, which achieves an overall score of 0.48. However, my implementation only yields a score of 0.13, which...