user-0a comments

Repositories
Issues
Comments

Results 7 comments of


                                            user-0a

TensorRT-LLM Requests

+1 for Command R Plus! CohereForAI/c4ai-command-r-plus

Support for Cohere Command-R

Would also like support for this! Thank you for all of the hard work @ncomly-nvidia

[Feature request] Cohere Family of Models (Command-R, Command-R-Plus, Aya23-8B, Aya23-35B, Aya101)

Thank you!

[Research]: Cloudflare Durable Objects

Very interested in this!

[BUG]: TypeError: Cannot read properties of undefined (reading 'columns')

+1, seeing this error as well

Support Cohere Command-A (Cohere2ForCausalLM arch)

+1, would also like support for this!

Support for TensorRT-LLM

This can likely be implemented with the Executor API: https://github.com/NVIDIA/TensorRT-LLM/blob/31ac30e928a2db795799fdcab6be446bfa3a3998/examples/cpp/executor/README.md#L4