ihubanov

Do you have a simple guide on how you did it for previous JetPack releases... Another question, do you happen to know if any of the other containers provide similar...

Man when I try the `./build.sh text-generation-inference` it crashes with 'package 'text-generation-inference' not found... Also ./build.sh --list-packages doesn't show it... Tried replacing the config.py with the one from webui, but...

Same in jetpackpack=6.0 DP

Got it! I'll just try to improve the summary prompt. However I still think this is not efficient. My best guess is in ChatGPT they are passing at least 2...

Wow... indeed, I just tested as well... Well it seems I've not been using it for a while since I started using Mixtral large :D

@nsarrazin I'm ready to submit a PR, but can you help me with steps to do so? Maybe the easiest will be to fork the repo and then I will...

Yes, because it seems there are some issues when detecting the stop sequence and when I'm using llama model for chat and it uses Mistral for tasks llama fails to...

``` MODELS=` [ { "name": "mistralai/Mistral-7B-Instruct-v0.2", "displayName": "mistralai/Mistral-7B-Instruct-v0.2", "description": "Mistral 7B is a new Apache 2.0 model, released by Mistral AI that outperforms Llama2 13B in benchmarks.", "websiteUrl": "https://mistral.ai/news/announcing-mistral-7b/", "preprompt":...

Man I'm also trying to run it on a Jestson AGX Orin, looks like the best option would be to setup a "[jetson-container](https://github.com/dusty-nv/jetson-containers/blob/master/docs/build.md)", but no luck... I think the main...

I think the main issue is that exo needs python 3.12, which in turn needs newer libraries... Maybe a better approach would be to get someone from Jetson team to...