gpt-fast icon indicating copy to clipboard operation
gpt-fast copied to clipboard

Code is extremely slow!

Open yafehlis opened this issue 1 year ago • 2 comments
trafficstars

I am using AMD MI210s. After loading the models, the following steps are extremely slow (see screenshot). It turned out the Compilation time is 270 seconds. Could you please help me fix it and make it run faster? Thanks, Yao Fehlis (AMD) Capture

yafehlis avatar Jan 09 '24 20:01 yafehlis

@yafehlis Can you run the following script to collect the sys env?

wget https://raw.githubusercontent.com/pytorch/pytorch/main/torch/utils/collect_env.py
# For security purposes, please check the contents of collect_env.py before running it.
python collect_env.py

yanboliang avatar Feb 01 '24 06:02 yanboliang

@yafehlis are you seeing the same issue with rocm 6.2?

petrex avatar Nov 11 '24 23:11 petrex