fiddler-auditor icon indicating copy to clipboard operation
fiddler-auditor copied to clipboard

Add ChainEval Class

Open mstfatay opened this issue 2 years ago • 1 comments

Right now there is only one evaluation class which is LLMEval. This class can only evaluate Langchain's LLM objects. I suppose we need to add support for langchain's Chain objects too because they are the most largely used langchain objects.

I suppose we can inherit both LLMEval and ChainEval from a new class called BaseEval.

mstfatay avatar Jun 30 '23 13:06 mstfatay

This would be a fantastic addition! Thank you for taking out time to raise this @mstfatay !

iterix2 avatar Jun 30 '23 18:06 iterix2