Tuhin Chakrabarty

T0 (p=1) replicability

1

Hi @VictorSanh Thanks for releasing the code and data. I am trying to retrain it in pytorch Some questions , in your paper you have p=1 vs p=5.7 results Say...

I see the max_seq_length and max_position is set to 32 and 64. Currently, when I was trying to do it with bigger size I was getting OOM even for batch...

Possible to share the books corpus

1

Hello I was wondering if you could share the books corpus as the crawling takes pretty long. I was using it https://github.com/soskek/bookcorpus

Off the shelf generation from trained hyperformer++

6

``` from hyperformer.adapters import AdapterController, AutoAdapterConfig from hyperformer.third_party.models import T5Config, T5ForConditionalGeneration from transformers import AutoTokenizer, set_seed import os os.environ["CUDA_VISIBLE_DEVICES"]="0" set_seed(42) config = T5Config.from_pretrained('t5-3b',cache_dir="/local/nlpswordfish/tuhin/") tokenizer = AutoTokenizer.from_pretrained('t5-3b',cache_dir="/local/nlpswordfish/tuhin/") adapter_config = AutoAdapterConfig.get('meta-adapter') #####################...

RUN git clone https://github.com/nvidia/apex && \ cd apex && \ python setup.py install --cuda_ext --cpp_ext && \ rm -rf /apex Hi I am wondering if there is a root cause...

The command '/bin/sh -c git clone https://github.com/nvidia/apex && cd apex && python setup.py install --cuda_ext --cpp_ext && rm -rf /apex' returned a non-zero code: 1 Hi Building the docker is...