paper-qa icon indicating copy to clipboard operation
paper-qa copied to clipboard

Increasing token count

Open Litreviewing opened this issue 1 year ago • 1 comments

How can I increase the token count for a query response in CLI?

Litreviewing avatar Oct 11 '24 10:10 Litreviewing

To increase the token count for a query response in CLI, modify the max_tokens parameter in the request body. For example, change it from:

"max_tokens": 3

to a higher value like:

"max_tokens": 100

This will increase the token count for the response [1].

To continue talking to Dosu, mention @dosu.

dosubot[bot] avatar Oct 11 '24 10:10 dosubot[bot]