max_tokens error

[lakshmanok]

This appears to be an internal error:

  File "/opt/conda/lib/python3.10/site-packages/dspy/primitives/program.py", line 27, in __call__
    return self.forward(*args, **kwargs)
  File "/home/jupyter/lakblogs/bridge_bidding_advisor/bidding_advisor.py", line 107, in forward
    return self.prog(definitions=definitions,
  File "/opt/conda/lib/python3.10/site-packages/dspy/predict/predict.py", line 49, in __call__
    return self.forward(**kwargs)
  File "/opt/conda/lib/python3.10/site-packages/dspy/predict/chain_of_thought.py", line 60, in forward
    return super().forward(signature=signature, **kwargs)
  File "/opt/conda/lib/python3.10/site-packages/dspy/predict/predict.py", line 90, in forward
    x, C = dsp.generate(template, **config)(x, stage=self.stage)
  File "/opt/conda/lib/python3.10/site-packages/dsp/primitives/predict.py", line 101, in do_generate
    max_tokens = kwargs.get("max_tokens", dsp.settings.lm.kwargs["max_tokens"])
KeyError: 'max_tokens'

I tried to pass in max_tokens as follows:

dspy.settings.configure(lm=gemini, max_tokens=1024)

and by trying:

def forward(self, question):
        ...
        return self.prog(..., max_tokens=1024)

Neither works.