Fei Han

icon location New Jersey icon location Applied Scientist at Amazon | Machine Learning and Generative AI

Results 1 issues of Fei Han

Do we need to chunk documents before text set generation?

3 comment

The embedding model is used for TestsetGenerator: ```py generator = TestsetGenerator.from_langchain(generator_llm, critic_llm, embedding_model) dataset = generator.generate_with_langchain_docs(documents, test_size=100, distributions={simple: 0.5, reasoning: 0.25, multi_context: 0.25}) ``` Does this mean we have to...

question
module-testsetgen