Aaron Nicolson

Hi LYJ0327, Unfortunately, pycocotools is not my package, maybe the authors of this package will be better able to help you with this. Sorry I couldn't help you better with...

Hi LYJ0327, Which part is hard to understand?

Hi, Hugging Face tokenises is used for tokenisation: https://huggingface.co/learn/nlp-course/en/chapter2/4 The Hugging Face decoder converts the tokens into embeddings using the torch.nn.Embedding class: https://pytorch.org/docs/stable/generated/torch.nn.Embedding.html Embeddings can be given as input to...

Hi xiaofengstudent, Please download the CheXbert checkpoint from https://github.com/stanfordmlgroup/CheXbert for the CE metrics. Place the checkpoint at checkpoints/stanford/chexbert/chexbert.pth. Thanks, Aaron

Hi jinghaoliu, I think I know the issue, I'll fix it and then get back to you. Shouldn't take too long.

There was an error in the configuration file. I've pushed an update, but the error was caused by lines 131 and 140 of https://github.com/aehrc/cvt2distilgpt2/blob/main/config/cvt_21_to_distilgpt2.py (which has been updated). Thanks for...

Hi jinghaoliu, There were a few issues in: https://github.com/aehrc/cvt2distilgpt2/blob/main/transmodal/generate.py https://github.com/aehrc/cvt2distilgpt2/blob/main/transmodal/model.py I updated the code a bit after doing these experiments and did not test everything after the updates (silly me)....

Hi @NatthananR, I have added the CE metrics to the repo: https://github.com/aehrc/cvt2distilgpt2/blob/main/transmodal/metrics/chexbert.py. The config files have been updated to use them :) Please let me know if you have any...

Hi, Please see the updated README.md for the labels from Chen et al. https://github.com/aehrc/cvt2distilgpt2 I will look into the discrepency with the results.

Hi, there are some errors in the preprint, the correct results are reported in the updated repository.