Daniel Kirsch

Replication fails

3

See https://issues.apache.org/jira/browse/COUCHDB-1524

Hi, it'e me again. I'm not sure this is the right place for my question but I'll just go ahead and ask. I've been playing around with this library extensively...

[Feature request]: Serve Agent as OpenAI chat completions endpoint

1

### What do you need? I think nerve could do something similar to https://github.com/SecretiveShell/MCP-Bridge but in a more flexible way. If this isn’t a goal for nerve then https://github.com/SecretiveShell/MCP-Bridge can...

[Bug]: litellm.UnsupportedParamsError with bedrock eu.anthropic.claude-3-7-sonnet-20250219-v1:0

3

### What happened? I've set ``` export NERVE_GENERATOR="bedrock/eu.anthropic.claude-3-7-sonnet-20250219-v1:0" ``` and get ``` [04-10-25 16:26:10] ERROR litellm.UnsupportedParamsError: bedrock does not support parameters: ['tool_choice'], for model=eu.anthropic.claude-3-7-sonnet-20250219-v1:0. To drop these, set `litellm.drop_params=True` or...

Tensor parallel vllm fails on eGPU

13

**Describe the bug** When I try to run the vLLM container https://github.com/intel/ipex-llm/blob/main/docs/mddocs/DockerGuides/vllm_docker_quickstart.md with `tensor_parallel_size=2` on my 2 A770 system where the second A770 is connected to the m2 slot of...