aihenry

icon location Hong Kong icon location AI enthusiast, technology explorer, an ordinary person full of imagination.

Results 2 issues of aihenry

How to handle the token limitation for a LLM response?

2 comment

Hi, When the LLM generate a long answer that exceeded 512 tokens, the program start to show warning message like this: WARNING:ctransformers:Number of tokens (513) exceeded maximum context length (512)...

FileNotFoundError: Could not find module '...ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies).

3 comment

Hi, i can run below code last week without problem but i got below error since some days ago (after upgrade ctransformers lib). I am unable to run ctransformers with...