NUIST-EC

Some projects of evolutionary computation, swarm intelligence, large language models, agents

Results 4 comments of


                                            NUIST-EC

trafficstars

Can not use tool and function-call?

官方api本身可以进行function calling，但是似乎自己本地的模型在function calling时总是匹配不到

AttributeError: 'GenerationConfig' object has no attribute '_eos_token_tensor'

同样的错误

[Bug] triton.runtime.autotuner.OutOfResources: out of resource: shared memory, Required: 108672, Hardware limit: 101376. Reducing block sizes or `num_stages` may help.

我在vllm上能正常部署

[Bug] triton.runtime.autotuner.OutOfResources: out of resource: shared memory, Required: 108672, Hardware limit: 101376. Reducing block sizes or `num_stages` may help.

我尝试进行了修改，但很遗憾，这不奏效