weave icon indicating copy to clipboard operation
weave copied to clipboard

[WIP] Add `Scorer` Docs

Open NiWaRe opened this issue 10 months ago • 2 comments

This is a WIP docs PR to:

  • add an example LLM Correctness Judge by overwriting the weave.flow.scorers.Scorer class to the RAG tutorial
  • add API docs for Scorer
  • add some general best practices to defining scorers

NiWaRe avatar Apr 17 '24 14:04 NiWaRe

CLA Assistant Lite bot:
Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.


I have read the CLA Document and I hereby sign the CLA


5 out of 6 committers have signed the CLA.
:white_check_mark: @jtulk
:white_check_mark: @ibindlish
:white_check_mark: @gtarpenning
:white_check_mark: @ericakdiaz
:white_check_mark: @wandb-kc
:x: @NiWaRe
You can retrigger this bot by commenting recheck in this Pull Request

github-actions[bot] avatar Apr 17 '24 14:04 github-actions[bot]

I pulled from master and it has too many changes now. Created https://github.com/wandb/weave/pull/1720 to replace this

scottire avatar Jun 06 '24 10:06 scottire