generative-ai icon indicating copy to clipboard operation
generative-ai copied to clipboard

feat: add rag eval pipeline for ops

Open inardini opened this issue 1 year ago • 2 comments

This notebook shows how you can use Vertex AI Pipelines to build a GenAI Model Evaluation Batch pipeline to evaluate a question-answering task with Rapid Eval API and DataflowML.

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • [x] Follow the CONTRIBUTING Guide.
  • [x] You are listed as the author in your notebook or README file.
    • [x] Your account is listed in CODEOWNERS for the file(s).
  • [x] Make your Pull Request title in the https://www.conventionalcommits.org/ specification.
  • [x] Ensure the tests and linter pass (Run nox -s format from the repository root to format).
  • [x] Appropriate docs were updated (if necessary)

inardini avatar Aug 26 '24 23:08 inardini

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

🤖 I detect that the PR title and the commit message differ and there's only one commit. To use the PR title for the commit history, you can use Github's automerge feature with squashing, or use automerge label. Good luck human!

-- conventional-commit-lint bot https://conventionalcommits.org/

Closing due to inactivity. Please re-open once comments are addressed.

holtskinner avatar Nov 05 '24 17:11 holtskinner