Optimum for Jetson Orin Nano

[JunyiYe]

System Info

optimum version: 1.17.1
platform: Jetson Orin Nano, Jetpack 6.0
Python: 3.10.13
CUDA: 12.2

Who can help?

No response

Information

• [X] The official example scripts
• [ ] My own modified scripts

Tasks

• [ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• [X] My own task or dataset (give details below)

Reproduction (minimal, reproducible, runnable)

Here is how I installed.

1. install Pytorch 2.2.0 following https://elinux.org/Jetson_Zoo
2. install onnxruntime-gpu 1.17.0 following following https://elinux.org/Jetson_Zoo
3. install Optimum by using pip install optimum[onnxruntime-gpu]

Expected behavior

The Optimum installed on my Jetson Orin Nano not support GPU for Jetpack 6.0 and Python 3.10.13.

Can anybody let me know how to install it?

[fxmarty]

Hi @JunyiYe thank you, could you share which behavior you expect, and which behavior you are getting?