UserName-wang

Please update jetson-stats with this board **Board** - Board(s): P3509-000 - Boardis: - SOC: tegra194 - ID: - Code Name: jakku **Jetpack** - Jetpack: 5.0.2 - L4T: 35.1.0 **Jetson-Stats** -...

what's --chat-template ? and how to config it?

7

Hi, I tried to use Llama2-Chinese-13b-Chat, but got this error: File "/opt/local_llm/local_llm/history.py", line 89, in __init__ raise RuntimeError(f"Couldn't automatically determine model type from {model.config.name}, please set the --chat-template argument") RuntimeError:...

agx xavier dustynv/local_llm:r35.3.1 error

3

hardware information: agx xavier, L4T:35.4.0, Jetpack:5.1.2. and cloned the branch R35.4.1. I tried below commands in container dustynv/local_llm:r35.3.1 and had error: root@agx-xavier:/data/models/mlc/dist/models# python3 -m local_llm --api=mlc --model=Llama-2-7b-chat-hf /usr/local/lib/python3.8/dist-packages/transformers/utils/hub.py:123: FutureWarning: Using...

NeMo doesn't support Jetson.

2

just let you know that NeMo doesn't support Jetson. https://github.com/NVIDIA/NeMo/issues/7331 but what's the docker image used for? [dustynv/nemo:r35.3.1](https://hub.docker.com/r/dustynv/nemo/tags)

try to build built container images failed

9

Hi there, my environment is: Jetson AGX xavier running Jetpack 5.1.1, and L4T version R35.3.1, command: ./build.sh --name=my_container ros:humble-desktop /usr/lib/python3/dist-packages/requests/__init__.py:89: RequestsDependencyWarning: urllib3 (1.26.16) or chardet (3.0.4) doesn't match a supported...

stderr: nvblox FindDoxygen not find

8

Environment: Orin agx, L4T:35.4.1, Jetpack:5.1.2, python 3.8.10, ubuntu 20.04 in a docker, which build by command: cd ${ISAAC_ROS_WS}/src/isaac_ros_common && \ ./scripts/run_dev.sh ${ISAAC_ROS_WS} error after command in the docker: cd /workspaces/isaac_ros-dev...

[BUG]: Cannot select txt file in a folder

2

### How are you running AnythingLLM? Docker (local) ### What happened? Cannot select txt file in a folder. AnythingLLM can display the folder "txt" correctly. but cannot display the txt...

我尝试这样写的： 'Llama2-Chinese': { 'system_prompt': "A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.", 'system': '${MESSAGE}\n\n', 'user':...

Not sure if ollama:r36.2.0 is using GPU

3

Dear @dusty-nv , I pulled dustynv/ollama:r36.2.0 on jeston orin 32G DEV. run command: jetson-containers run --name ollama $(autotag ollama), the output are: [GIN-debug] [WARNING] Running in "debug" mode. Switch to...

Hi, On jetson Xavier NX, L4T: 35.4.1, Jetpack:5.1.2： Try to run command: cd /workspaces/isaac_ros-dev && \ colcon build --symlink-install && \ source install/setup.bash Got error messages: This may be promoted...