code_puppy icon indicating copy to clipboard operation
code_puppy copied to clipboard

Feature Request: Add Recommended Sampling Parameters for GLM Model

Open diegonix opened this issue 2 months ago • 0 comments

Feature Request: Add Recommended Sampling Parameters for GLM Model

Description When using the GLM model, we should include the following sampling parameters to align with the official recommendations from the model authors:

{
  "temperature": 1,
  "top_k": 40,
  "top_p": 0.95
}

These values are specified in the [GLM-4.6 model page on Hugging Face] and are the defaults used in their reference implementation.

Rationale These parameters provide a better balance between creativity and determinism, especially for code generation and programming-related tasks. According to the model authors, this configuration improves coherence and consistency in logical text outputs — which makes it particularly effective for structured reasoning and writing code.

References

diegonix avatar Oct 27 '25 00:10 diegonix