Is there an easy way to add generation of multiple possible sequences?

[vladimirlitvinyuk]

[Coriana]

Isn't that literally what Num_samples in sample.py is for?

runs off x number of possible sequences?

or are you meaning stop part way through and then give options of branching output?

[vladimirlitvinyuk]

Hi. Sorry for long answer. As far as I can see, samples are generated independently, so unique sequences are not guaranteed. I need to get strictly unique sequences as a minimum requirement. However, stop part way through and give options of branching output could be also an interesting case.

[VatsaDev]

@vladimirlitvinyuk

You are talking about a model with anywhere between 124 million to 1.5 billion parameters. It doesn't make duplicates very often, unless you give it some very narrow input.

About your other mention, with branching outputs, make a loop and put the generation function in it, give generate function very few tokens to generate, and do it all over again