Olivier Valery

dockerfile

1

Thank for this project. Can you provide a dockerfile to easily test lighttrack ?

Thanks for this great work @taki0112 Can you also include in your tutorial some examples of output obtained via your tensorflow-based code ? Thanks a lot,

The weights

2

Can you provide your models weight ? I would like to reproduce the experience of the paper. Thanks, Best regards,

Thank you for work and sharing this code. I was wondering the meaning of ```new_grad = torch.ones_like(grad)``` in the following code in universal.py. ``` def _backward_hook(self, grad): self.out_mask += grad.data.abs().sum(2,...

convolution layer with cardinality

4

Dear author, Thank for this impressive piece of work. How to implement convolution layer with cardinality ? in universal.py we have: ``` def melt(self): if self.conv.groups == 1: groups =...

TensorRT - avg_logprob

4

Thanks for your really impressive work. I was wondering how to extract the token probability with TensorRT (a little bit lit what you did in this example with ctranslate2) ```...

How to change num_beams over multiple runs ?

1

### System Info NVIDIA RTX A6000 ### Who can help? @juney-nvidia Hi I'm interested in using TensorRT-LLM for multiple inference inferences, but I'd like to be able to adjust the...