llama-stack-apps

llama-stack-apps copied to clipboard

Clarification on the system prompt for custom tool use

15

Awesome work! Just a quick question about the correct system prompt: in the docs https://llama.meta.com/docs/model-cards-and-prompt-formats/llama3_1#user-defined-custom-tool-calling this is used: ``` If a you choose to call a function ONLY reply in...

ricklamers

File Upload not working

2

When trying to work with a file upload, the file is basically ignored:  I have used the standard setup from the README, i.e.: * created and activated a `conda`...

uhasker

I have some trouble on llama distribution install --spec local --name local-llama-8b

1

When I implement `llama distribution install --spec local --name local-llama-8b`, I encounter the following error: /home/miyai/.pyenv/versions/miniconda3-latest/envs/agentic_env/lib/python3.10/site-packages/llama_toolchain/distribution/install_distribution.sh: line 111: PS1: unbound variable Failed to install distribution local Do you know any...

AtsuMiyai

Tool Calling Not Working

8

I am trying the tool calling function with Brave Search engine by following the simple instructions at https://github.com/meta-llama/llama-agentic-system#add-api-keys-for-tools. Basically, I saved the api key inside an .env file by `BRAVE_SEARCH_API_KEY=xxxxx`...

dawenxi-007

Step by step instructions to install and run the Llama Stack on Linux and Mac

13

I managed to make the Llama Stack server and client work with Ollama on both EC2 (with 24GB GPU) and Mac (tested on 2021 M1 and 2019 2.4GHz i9 MBP,...

jeffxtang

Error: Failed to initialize the TMA descriptor 801

2

Good day everyone, I am trying to run llama agentic system on RTX4090 with FP8 Quantization for the inference model and meta-llama/Llama-Guard-3-8B-INT8 for the Guard. WIth sufficiently small max_seq_len everything...

anret

Unable to Install and Configure Distributions on Lightning.ai

1

I am getting the following error: > llama distribution install --spec local --name local-llama-8b ``` Using local-llama-8b as the Conda environment for this distribution Conda environment 'local-llama-8b' does not exist....

kumar19a

when Interact with the Server, All connection attempts failed

5

I start an App and Interact with the Server, when I print "hello", it reported the error shown in the picture below:  Then I start a script that can...

YinSonglin1997

Bug?: Embedded and Malicious Probabilities (index 2 is out of bounds for dimension 1 with size 2)

3

Hello, I get this error when running the model locally, as described by the repo. however, I get this error: index 2 is out of bounds for dimension 1 with...

mburges-cvl

FP8 quantizatin examples

1

When will FP8 quantizatin examples be released? Thanks!

zitgit