Josh

> temp: 0.9 top_k: 420 top_p: 0.9 repeat_last_n: 64 repeat_penalty: 1.3 I'm using these params and I'm getting fairly short responses too. (using your 30B). `sampling parameters: temp = 0.900000,...