Christopher J Leblanc comments

Results 2 comments of


                                            Christopher J Leblanc

Thanks for your help! I upgraded my VM and ran the 90b model with the same issue. The context window is 128K just like GPT so I wonder why it's...

I was running LLAMA locally, but I think it should be just /api/generate maybe? Sorry that environment is one now so it's only my memory