SciFive icon indicating copy to clipboard operation
SciFive copied to clipboard

Do the gs: files in the code still exist?

Open bhomass opened this issue 2 years ago • 2 comments

I am trying out the code in scifive_pretrain_base.ipynb.

I got OSError: Unable to open file for all the gs: files in the code 'gs://t5_training/t5-data/config/pretrained_models_google_base_operative_config.gin' gs://mindxhack/bio_sentence_piece_small.txt

I tried look them up using the google cloud storage browser and don't see these files.

The browser does find the model files like gs://scifive/models/pubmed_pmc/base

So the question is whether this is working code as is. Do these dependent files still exist on the cloud?

bhomass avatar Jul 13 '22 04:07 bhomass

Hi @bhomass , gs://mindxhack/bio_sentence_piece_small.txt should be any text file of your own to train a tokenzier model for model

justinphan3110 avatar Jul 13 '22 05:07 justinphan3110

what about gs://t5_training/t5-data/config/pretrained_models_google_base_operative_config.gin. without, the model can not load the pretrained configuration.

I am getting RuntimeError: Required bindings for make_layer_stack not provided in config: ['layers'] In call to configurable 'make_bitransformer' (<function make_bitransformer at 0x7f618986b200>)

when running model.train(mixture_or_task_name = 'all_bioT5', steps = 1000000+300000)

bhomass avatar Jul 20 '22 21:07 bhomass