gtvforever

How to set batch size for using deepspeed inference API?

2

Hi folks, I followed the tutorial from https://www.deepspeed.ai/tutorials/inference-tutorial/#end-to-end-gpt-neo-27b-inference and wrote below code to run gpt2-xl inference. ``` import os import deepspeed import torch from transformers import pipeline local_rank = int(os.getenv('LOCAL_RANK',...

Some code couldn't work smoothly now. Please update the code if u have time slot.

PAGINATION_DIRECTIVES doesn't work on demo.

4

Hi, just copied the demo ts & html into my project. When i tried to launch the app with the command 'npm start'. i got below error message: '(20,9): error...

protractor-istanbul-plugin didn't work

1

Hi there, i just installed this plugin into my project and edited the protractor.conf.js per doc suggested. When i ran the e2e testing, there's no code coverage json files generated...