stopping_strings not working for me

[danpizzy]

Describe the bug

ive tried using 'stopping_strings': ["Human"], on the vicuna model and it doesnt work

Is there an existing issue for this?

• [X] I have searched the existing issues

Reproduction

using the api

Screenshot

No response

Logs

### Human: Create a list of H1 headings for this article
### Assistant: 1. Introduction to StoryAI
2. The Unique Selling Point of StoryAI
3. In-Depth Description of StoryAI
4. Top Features of StoryAI

System Info

google colab api with  linux

[karlovm]

I've already fixed this bug. It's on PR now

[CyberTimon]

I've already fixed this bug. It's on PR now

I've tried this but it still doesn't stop. Are you sure this works with the latest commit?

[schauppi]

Do not work for me either.

Edit: NVM: Wrong formatting. With the stable-vicuna-13B-GPT model the following works for me: 'stopping_strings': ["\n###"],

[github-actions[bot]]

This issue has been closed due to inactivity for 6 weeks. If you believe it is still relevant, please leave a comment below. You can tag a developer in your comment.