transformers-js icon indicating copy to clipboard operation
transformers-js copied to clipboard

Model giving extremely short prompts

Open VatsaDev opened this issue 1 year ago • 0 comments

I have this code

import { pipeline } from "https://cdn.jsdelivr.net/npm/@xenova/[email protected]";

      let storyTeller = await pipeline(
        "text2text-generation",
      );

      async function story() {
        let result = await storyTeller("give a story on XXX", { // example
          min_new_tokens: 1000,
          temperature: 0.6,
          repetition_penalty: 5,
          no_repeat_ngram_size: 1,
        });

        console.log(result);
        document.getElementById("output").innerHTML = result;
      }

However this often gives me one word or a sentence at best, even if I set min_new_token to 2000 or more. Why is that?

VatsaDev avatar Jun 30 '23 13:06 VatsaDev