Add back support for Langchain Evalchains

Open jjmachan opened this issue 1 year ago • 3 comments

Describe the Feature with V0.1, support for langchain EvalChain is broken, add that back in

Feb 07 '24 01:02 jjmachan

Any ETA? Or some architecture/code scaffolds so at least I can help accelerate this?

Feb 12 '24 19:02 leehanchung

hey @leehanchung , you could invoke (or ainvoke()`) it in a loop and create the dataset to evaluate.

refer this notebook.

This might take some time for me to fix -worst case 2 weeks. I apologize for the hard time 🙁

Feb 19 '24 06:02 jjmachan

@jjmachan thanks for your work!!

Is there any additional progress made on this issue?

Mar 11 '24 02:03 rere950303