text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

wip: comment out prepend full_text

Open jrc2139 opened this issue 7 months ago • 2 comments

What does this PR do?

This is an investigation as to why using "return_full_text": true as a parameter in hitting the /generate endpoint produces a valid translation while running madlad400

Background: https://github.com/huggingface/text-generation-inference/issues/1416#issuecomment-2705165023

Fixes #1416

Before submitting

  • [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • [ ] Did you read the contributor guideline, Pull Request section?
  • [x] Was this discussed/approved via a Github issue or the forum? Please add a link to it if that's the case.
  • [ ] Did you make sure to update the documentation with your changes? Here are the documentation guidelines, and here are tips on formatting docstrings.
  • [ ] Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR.

jrc2139 avatar Mar 07 '25 00:03 jrc2139