storm icon indicating copy to clipboard operation
storm copied to clipboard

[New RM] Add duckduckgo retriever

Open kosiew opened this issue 1 year ago • 2 comments

Add retriever DuckDuckGoSearch

DuckDuckGoSearch is a free web search API that does not require an API key.

--retriever will accept duckduckgo

eg

python examples/run_storm_wiki_gpt.py --retriever duckduckgo --do-research --do-generate-outline --do-generate-article --do-polish-article --remove-duplicate --max-perspective 5 --max-thread-num 5 --output-dir $OUTPUT_DIR

kosiew avatar Jul 30 '24 09:07 kosiew

Sorry for the formatting diff.

I used yapf and .style.yapf

[style]
based_on_style = pep8
column_limit = 79
# Add any other configurations you prefer here

but it still introduced a lot of formatting diff.

kosiew avatar Jul 30 '24 09:07 kosiew

Thank you so much for working on this!

but it still introduced a lot of formatting diff. We already know this issue. We will set up a formatter to make the contribution less painful. For this PR, could you manually revert change on parts unrelated to DuckDuckGoSearch? This could help us merge it. Thanks!

shaoyijia avatar Jul 30 '24 13:07 shaoyijia

Close it because DuckDuckGo has been supported. Thanks for working on this though!

shaoyijia avatar Aug 23 '24 04:08 shaoyijia