haystack-core-integrations icon indicating copy to clipboard operation
haystack-core-integrations copied to clipboard

Published 20 hours ago • verified publisher icon deepset-ai

MistralChatAdapter: Typo in the `max_tokens`

Open vish9812 opened this issue 1 year ago • 0 comments

MistralChatAdapter's ALLOWED_PARAMS has max_tokens but generation_kwargs is using max_gen_len. Because of this discrepancy, max_tokens limit is set to the default 512 whenever running the model.

  • Haystack version: 2.1.2
  • Integration version: 0.7.1

Related PR - https://github.com/deepset-ai/haystack-core-integrations/pull/740

vish9812 avatar May 21 '24 06:05 vish9812