Aidan Do

Results 53 comments of Aidan Do

I'm currently look into this issue. I can reproduce the error. Getting OOM errors for files 100mb locally. Just from what I've gathered, it seems like it's possible to stream...

@yaseco Testcontainers doesn't network mode `host` currently. There's still some discussion going around surrounding that. See https://github.com/testcontainers/testcontainers-java/issues/5151. The main concern atm, is that it's a platform dependent change (network mode...

I just realized there's another PR that aims to achieves something similar https://github.com/aws/aws-cli/pull/5482/ but with a different approach. Up to you guys which approach you want to choose.

One drawback of my approach is that it's difficult to provide useful error messages; It's difficult to determine whether the argument passed in is an invalid yaml document or shorthand...

The more I think about it, the more file extension based matching makes more sense. Let me know if you want me to redo this PR

I've been able to reproduce: https://github.com/aidando73/llama-stack-apps/pull/3/files#diff-1ebfaf6cb3592166b73835fa82333cb7109e7c624865c0039a7b22ff34aa27fa ```python Traceback (most recent call last): File "/Users/aidand/dev/llama-stack/llama_stack/distribution/server/server.py", line 158, in sse_generator async for item in event_gen: File "/Users/aidand/dev/llama-stack/llama_stack/providers/inline/agents/meta_reference/agents.py", line 153, in _create_agent_turn_streaming async...

tl;dr: The model is hallucinating and we don't check whether the client passed in the `code_interpreter` tool. The inference [request](https://github.com/meta-llama/llama-stack/blob/a05e7a583739353d7de6f9e87b0341bd9d8118fe/llama_stack/providers/remote/inference/ollama/ollama.py#L212) the model gets is correct: ```python tools=[ToolDefinition(tool_name=, description=None, parameters=None)] ```...

Yeah I'm running into this error as well

+1 - useful for us contributors as well so we know how the apis should be behaving. E.g., when adding a new provider