Rubén Cruz García comments

Repositories
Issues
Comments

Results 2 comments of


                                            Rubén Cruz García

Synthesizer generates goldens but a dataset loads as test cases

Hi @penguine-ip . Is there any workaround for this? The "evaluate" function doesn't admit "golden" as an argument, so providing goldens as test cases leads to empty evaluation: `No test...

AttributeError

Hi! Something similar happens to my evaluation dataset, which is a dataframe with columns: ['user_input', 'reference_contexts', 'reference', 'synthesizer_name'], created with **generator.generate_with_langchain_docs**. The error is: `AttributeError: 'DataFrame' object has no attribute...