danwei
danwei
Have you solved this problem?
> @danwei1992 Not yet. Did you encounter the same problem? No, I also choose 3 but I got the problem about OOM with 8*v100 32G
> I also posted https://github.com/tatsu-lab/stanford_alpaca/files/11024692/Mar20_05-17-08_0c56f6779a08.csv csv log file! > > I takes approx. 24hours(a day) > > This is strange. You are using way better gpus than mine. As you...
Is this inference code useful for huggingface model inference?