Hongjun (Jun) Choi comments

Repositories
Issues
Comments

Results 1 comments of


                                            Hongjun (Jun)  Choi

Support for Mistral Nemo

Hello @byshiue It seems like Mistral 7B model is already supported https://github.com/NVIDIA/TensorRT-LLM/blob/5ddb6bf218ed16a2dcf0058f20c59a247e180fd2/examples/llama/README.md?plain=1#L1072 If the model architecture is the same, would that mean that we can also use existing scripts /...