Unable to match the generation of demo portal with local hosting the 7b model

[mriganktiwari]

• I am trying to generate with zero shot prompts in a local gpu setup.
• But with the same parameters as shown in the demo portal (i.e. temp=0.7, top_p=1.0), am not able the match the generations even in multiple trials.
• Neither was i able to find anywhere, any guide to good generations parameters.

Any suggestions or resource would be highly appreciated.

[yuege613]

the same promble with local 13-b model, much bad than their demo