ihubanov

No docker image for text-text-generation-inference on JetPack 6.0 DP

5

``` $ ./run.sh $(./autotag text-generation-inference) Namespace(packages=['text-generation-inference'], prefer=['local', 'registry', 'build'], disable=[''], user='dustynv', output='/tmp/autotag', quiet=False, verbose=False) -- L4T_VERSION=36.2.0 JETPACK_VERSION=6.0 CUDA_VERSION=12.2.140 -- Finding compatible container image for ['text-generation-inference'] Couldn't find a compatible container...

The prompt for title generation is not optimal

5

Hello, I've noticed that the prompt for title generation is not optimal. For example on my simple message `Hello`... The title I got was `💬 Hello! How can I help...

WebSearch uses the default model instead of current model selected

4

I have multiple models in my .env.local and it seems the WebSearch uses the default model to perform its search content extraction instead of the currently selected model (the one...