langchain-benchmarks

langchain-benchmarks copied to clipboard

- x - x - x - x - x - x - x - x - x - x - x

eyurtsev

Builds on https://github.com/langchain-ai/langchain/pull/14263/

rlancemartin

hinthornw

Issue #196 : Update evaluators.py

1

Changed the seed argument in ChatOpenAI function

abhinav-kimothi

get_eval_config() in langchain_benchmarks.rag ValidationError: 1 validation error for ChatOpenAI Parameters {'seed'} should be specified explicitly. Instead they were passed in as part of `model_kwargs` parameter. (type=value_error) ![Screenshot 2024-07-28 at 4...

abhinav-kimothi

A lot of RAG based chatbot is based on PDFs like documents, Also how to deal with PDF files is necessary for promoting the performance of RAG. Thanks in advance...

applepieiris

I have made a few changes to address the typos present and intentionally changed the filenames in the datasets.ipynb because the dataset ID used previously is "452ccafc-18e1-4314-885b-edd735f17b9d." However, as mentioned...

Kirushikesh

So each sample in the benchmark contains input(query) and output(reference, expected_steps, order_matters) which is visible in the langsmith UI, but when i try to download the same task benchmarks locally...

Kirushikesh

TLDR : I am trying to implement Semantic Few Shot for Tool calls, but error Does `SemanticSimilarityExampleSelector` actually works with using `List` as one for its `"messages"`? based on the...

komikndr

Incorrect version syntax was used.

legendof-selda