LLM-ToolMaker icon indicating copy to clipboard operation
LLM-ToolMaker copied to clipboard

How to start evaluating models with LATM?

Open DryPilgrim opened this issue 1 year ago • 0 comments

  1. 没有SFT模型吗?
  2. 这个工作是类似COT在prompt上做工作吗?
  3. 按照论文的意思,在评测和实际工作的时候,是不是需要三个模型?
  4. LATM的prompt在哪里呀,https://github.com/ctlllll/LLM-ToolMaker/blob/main/cot-prompts/chinese_remainder_theorem.txt 这个里面并没有给出工具集,找不到chinese_remainder_theorem的工具 find_number(max_limit, divisors, remainders)

//en

  1. Is there no SFT model?
  2. Is this work similar to how COT works on prompts?
  3. According to the meaning of the paper, are three models needed during evaluation and actual work?
  4. Where is the prompt of LATM? https://github.com/ctlllll/LLM-ToolMaker/blob/main/cot-prompts/chinese_remainder_theorem.txt There is no tool set given in this, and the tool find_number of chinese_remainder_theorem cannot be found. (max_limit, divisors, remainders)

DryPilgrim avatar Nov 14 '23 10:11 DryPilgrim