Aaron Nicolson

Hi, this has been fixed. Please pull again. Please let me know if there are any more issues. The error was there because the IU X-Ray LightningModule inherits from the...

Oh no. Can you please check if you can run the following in your environment: ``` BertTokenizer.from_pretrained('bert-base-uncased') ``` If you cannot, you likely have issues accessing Hugging Face hub/have a...

Hi, What is your current working directory and where is the absolute path of stages.py?

That's okay 😄

Hi, The class name in 'cvt2distilgpt2_mimic_cxr_chen' is 'CvT2DistilGPT2MIMICXRChen' rather than 'CvT2DistilGPT2'. I think the error is here: https://github.com/aehrc/cvt2distilgpt2/blob/main/config/test_mimic_cxr_chen_cvt2distilgpt2.yaml, I will update this, sorry about that.

Hi, That is concerning. I am training with the same config (`dlhpcstarter -t mimic_cxr -c config/train_mimic_cxr_chen_cvt2distilgpt2.yaml --stages_module stages --train --test `) to see if the issue occurs for me. After...

Here are the validation scores after 9 epochs: |epoch|step |train_loss_step|val_ce_precision_example|val_chen_rouge |val_chen_cider |val_ce_f1_macro |val_ce_num_examples|val_ce_recall_macro|val_chen_bleu_2 |val_chen_bleu_1 |val_ce_recall_example|val_chen_bleu_3 |val_ce_precision_micro|val_ce_f1_micro |val_ce_recall_micro|val_chen_bleu_4 |val_ce_f1_example |val_chen_num_examples|val_ce_precision_macro|train_loss_epoch| |-----|------|---------------|------------------------|-------------------|------------------|-------------------|-------------------|-------------------|-------------------|-------------------|---------------------|-------------------|----------------------|-------------------|-------------------|-------------------|-------------------|---------------------|----------------------|----------------| |0 |16924 | |0.40693270735524256 |0.31695191260859684|0.2920809223790337|0.20219941561024884|2130.0 |0.20641742878825722|0.22258831560611725|0.3392559885978699 |0.3729107981220657 |0.15715651214122772|0.454778469425119 |0.414069011501917 |0.38004895960832313|0.1176675483584404...

Hi LYJ0327, Could you please share your validation metrics? E.g., `experiments/mimic_cxr/train_mimic_cxr_chen_cvt2distilgpt2/trial_0/lightning_logs/version_6/metrics.csv`.

try version_0? Usually one is created for .csv files and the following one is created for tensorboard

Hi LYJ0327, Your validation and test scores for MIMIC-CXR seem as expected, differences caused by seed, etc. There is a high variability in the score over many training runs, e.g.,...