TaskWeaver icon indicating copy to clipboard operation
TaskWeaver copied to clipboard

Runing with transformer model loader on oobabooga/text-generation-webui problem

Open Wintoplay opened this issue 1 year ago • 1 comments

I cannot use taskweaver on api hosted by oobabooga/text-generation-webui. However, it work with llama cpp model loader on oobabooga/text-generation-webui which I cannot use it well as AMD rocm 5.7 has power draw bug. So I need to get this thing work with transfromers model loader.

image

Why do i get this error?

AssertionError: send_to field is None Exception: Planner failed to generate response because send_to field is None

Wintoplay avatar Dec 20 '23 11:12 Wintoplay

The issue of "send_to" field is None is usually caused by the incorrect LLM response. In TaskWeaver, the response is expected to follow a predefined schema (in json). However, if the LLM does not follow the instruction, the error would happen. A possible solution is to use a more powerful model.

ShilinHe avatar Jan 16 '24 03:01 ShilinHe