Runjia Zeng issues

Repositories
Issues
Comments

Results 1 issues of


                                            Runjia Zeng

Out of Memory Issue with OpenLLaMA-7B in Default FuseLLM Setting on A100 (80G)

# Description I am currently attempting to reproduce the results of your excellent work, FuseLLM, following the doc ([https://github.com/18907305772/FuseAI/blob/main/FuseLLM/README.md](https://github.com/18907305772/FuseAI/blob/main/FuseLLM/README.md)). During these operations, I am encountering an Out of Memory (OOM)...