generative-ai-docs
generative-ai-docs copied to clipboard
Sampler method Gemma Pytorch
Description of the feature request:
Is it possible to do sampling for n_samples with the GemmaCausalLM in PyTorch?
What problem are you trying to solve with this feature?
No response
Any other information you'd like to share?
No response