gpt-researcher icon indicating copy to clipboard operation
gpt-researcher copied to clipboard

llama3 does not return pure json

Open barsuna opened this issue 9 months ago • 3 comments

Testing gpt-researcher with llama3, i found that 3 times out of 4 llama3 will respond with json + some verbiage to prompt in generate_search_queries_prompt.

Not sure it is worth changing the prompt for sake of llama3 alone, but for documentation purposes here is the updated prompt that seems to work every time

before:

f'You must respond with a list of strings in the following format: ["query 1", "query 2", "query 3"].'

after

f'Your response must include list of the query strings in json format and nothing else. For example: ["query 1", "query 2", "query 3"]'

barsuna avatar May 21 '24 09:05 barsuna