context-is-key-forecasting icon indicating copy to clipboard operation
context-is-key-forecasting copied to clipboard

Published 20 hours ago • verified publisher icon ServiceNow

No instruct dp

Open AndrewRWilliams opened this issue 10 months ago • 1 comments

Adds support for using Direct Prompt for models that are do not support instructions in HF.

  • Checks if the tokenizer has a chat template.
  • If not, the context is simply concatenated into one long string and feed to the model.

AndrewRWilliams avatar Feb 06 '25 15:02 AndrewRWilliams

By the way, I'm testing if the code works for other base models. Will get back on that. Update: It works!! Yay!

ashok-arjun avatar Feb 14 '25 16:02 ashok-arjun