Ivo Schaper
Results
1
issues of
Ivo Schaper
I would like to use deepspeed-inference with the flan-t5 model and I have the following code: ``` def get_model(): model_name = "google/flan-t5-small" tensor_parallel = int(os.getenv("TENSOR_PARALLEL_DEGREE", "2")) local_rank = int(os.getenv("LOCAL_RANK", "0"))...