Do the gs: files in the code still exist?

[bhomass]

I am trying out the code in scifive_pretrain_base.ipynb.

I got
OSError: Unable to open file for all the gs: files in the code
'gs://t5_training/t5-data/config/pretrained_models_google_base_operative_config.gin'
gs://mindxhack/bio_sentence_piece_small.txt

I tried look them up using the google cloud storage browser and don't see these files.

The browser does find the model files like
gs://scifive/models/pubmed_pmc/base

So the question is whether this is working code as is. Do these dependent files still exist on the cloud?

[justinphan3110]

Hi @bhomass , gs://mindxhack/bio_sentence_piece_small.txt should be any text file of your own to train a tokenzier model for model

[bhomass]

what about gs://t5_training/t5-data/config/pretrained_models_google_base_operative_config.gin. without, the model can not load the pretrained configuration.

I am getting
RuntimeError: Required bindings for make_layer_stack not provided in config: ['layers']
In call to configurable 'make_bitransformer' (<function make_bitransformer at 0x7f618986b200>)

when running
model.train(mixture_or_task_name = 'all_bioT5', steps = 1000000+300000)