openchat icon indicating copy to clipboard operation
openchat copied to clipboard

Published 20 hours ago • verified publisher icon imoneoi

What are the default values in a sandbox

Open IgorBeHolder opened this issue 1 year ago • 4 comments

Hello, I am trying to reproduce the results of your "sandbox" with my on-premise deployment of openchat-3.5 model. The results are always dramatically different, so I am curious

  1. what are the SamplingParams for: presence_penalty frequency_penalty repetition_penalty top_p length_penalty max_tokens

  2. What is the actual model and if it is quantized?

Thanks in advance, Igor

IgorBeHolder avatar Dec 28 '23 10:12 IgorBeHolder

Are you talking about the online demo? The parameters of the online demo are as follows

  1. We set temperature 0.5, top_p 1, max_tokens 768, with any other sampling parameters turned off (including presence/frequency/repetition/length penalties)

  2. BFloat16 precision (unquantized)

imoneoi avatar Jan 02 '24 13:01 imoneoi

Thanks for immediate response

what template do you use on the online demo?

IgorBeHolder avatar Jan 02 '24 14:01 IgorBeHolder

hi hi there I CAN HELP YOU with my options for now but you gonna help me too okay I CAN GIVE you this week how to fix almost everything okay. On Tuesday, January 2, 2024 at 03:10:46 PM GMT+1, BeHolder @.***> wrote:

Thanks for immediate response

what template do you use at the demo?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you are subscribed to this thread.Message ID: @.***>

astra23 avatar Jan 04 '24 01:01 astra23

Thanks for immediate response

what template do you use on the online demo?

I also want to know

wac81 avatar Mar 11 '24 08:03 wac81