Po-Wei (Vincent) comments

Results 70 comments of


                                            Po-Wei (Vincent)

Add automatic labeling bot

> Thanks, can we add a failsafe to make sure `triaged` label isn't applied incorrectly in the validation step? LGTM Fixed in e74434b

I have a quick question about a method of unloading shared library

Closing this issue for now but feel free to reopen if you still have questions!

fix: The constructor checks useDynamicTree but doesn’t validate dynamicTreeMaxTopK if set

Closing as no activities from requester for +10 days. Feel free to reopen 👍

Increasing max_new_tokens drastically slows down inference

Hello @noahnisbet ! Is this issue still relevant? @kaiyux any updates on this?

Feature request: Ability to provide your own feature mask in ModelRunner class.

@ncomly-nvidia any updates on this?

convert to FP16 generate orphan and self-recurring nodes

Hi @xiaowuhu do you have any updates on this?

when a model has layers with and without GPT plugin enabled, GptSession raises error

@QiJune any updates on this?

RuntimeError: Failed to parse onnx

TensorRT should not have problems parsing models with non-ASCII paths, so it's likely that errors exist in the model. Feel free to share the model if possible so that we...

Failed to build TensorRT from source.

@kevinch-nv any updates? Can this be closed?

TensorRT python custom layer plugin support

Closing based on https://github.com/NVIDIA/TensorRT-LLM/issues/2265#issuecomment-2395953071. Please open a new issue for questions other than the original issue 👍