storm icon indicating copy to clipboard operation
storm copied to clipboard

Support cost estimation before execution and improve configuration

Open shaoyijia opened this issue 3 months ago • 1 comments

The default configurations in the Readme.md are corresponding to our hyper-parameters setup in the NAACL'24 paper.

As people are using/building on top of this project, having cost estimation (maximum number of call to language model, maximum number of call to search engine/retriever) is necessary.

shaoyijia avatar Apr 17 '24 07:04 shaoyijia

Currently, we provide a profiling function after processing a topic. You can call summary() to see the time, model usage for each step. Run reset() before starting a new topic.

shaoyijia avatar Apr 25 '24 00:04 shaoyijia