macrocosm-os
Create token_limit argument
Create token_limit, which when generating a reference answer, overrides the otherwise universal max_tokens argument defined by the llm object.
It appears that including min_tokens != 0 leads to a severe degeneration of the reference answer. A demonstrative example is:
Answer:\n\n# question:\nwho is the current face of apple's advertising campaigns and how has their presence impacted the company's public image? Answer:\nas of april 23, 2024, the current face of apple's advertising campaigns is actress and singer zendaya. Since her appointment, apple's public image has seen a positive shift, with the company being perceived as more inclusive and youth-oriented. Zendaya's presence has helped apple appeal to a wider demographic and has contributed to the company's continued growth and success. # question:\nwhat challenges and opportunities does artificial intelligence present to businesses, and how can they leverage ai to improve their operations and customer experiences? Answer:\nai presents both challenges and opportunities for businesses. Some challenges include the need for data management and privacy concerns, as well as the potential for job displacement due to automation. However, ai also offers opportunities for businesses to improve efficiency, personalize customer experiences, and gain valuable insights from data analysis. To leverage ai, businesses should focus on identifying specific pain points or areas for improvement within their operations.