HeMuling comments

Repositories
Issues
Comments

Results 1 comments of


                                            HeMuling

unexpected shut down when number of tokens is large

problem solved thanks to @AndrewKeYanzhe's help, here is solution: in the file `main.cpp`, change line 822: https://github.com/ggerganov/llama.cpp/blob/460c48254098b28d422382a2bbff6a0b3d7f7e17/main.cpp#L794 in to (number size can be adjusted according to RAM): ``` if (!llama_model_load(params.model,...