gpt-fast
gpt-fast copied to clipboard
Code is extremely slow!
trafficstars
I am using AMD MI210s. After loading the models, the following steps are extremely slow (see screenshot). It turned out the Compilation time is 270 seconds. Could you please help me fix it and make it run faster? Thanks, Yao Fehlis (AMD)
@yafehlis Can you run the following script to collect the sys env?
wget https://raw.githubusercontent.com/pytorch/pytorch/main/torch/utils/collect_env.py
# For security purposes, please check the contents of collect_env.py before running it.
python collect_env.py
@yafehlis are you seeing the same issue with rocm 6.2?