Apurba Bose

@peri044 Right now the dynamic input cases are supported, I will add some test cases for dynamic index. Although the implementation should support it. Also, is there any example script...

I ran the Mistral-7B-v0.3, it shows me this in the end- ``` INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:TRT INetwork construction elapsed time: 0:08:12.032557 INFO:torch_tensorrt [TensorRT Conversion Context]:Global timing cache in use. Profiling results in this...

Thanks for pointing out the bug. Will look at this, this week

Thanks for pointing this out. I looked into this a bit. TRT does not support fmod operation directly. So in torchTRT we implement it as `fmod(fmod(dividend, divisor) + divisor)` and...

I see this issue `Additional permissions required to list objects in this bucket. Ask a bucket owner to grant you 'storage.objects.list' permission`. Does this require me to create a service...

Thanks @HolyWu for pointing out the above. @narendasan would the changes in PR https://github.com/pytorch/TensorRT/pull/2855/files#diff-97c67f0cea25ec7aa88ca61594d9ad62e9fb575cab3647b079cb718f81308454 work or would we have to create a type map for kINT32 to kINT64 in the...

While testing the llama model I get this error - ``` torch.fx.experimental.symbolic_shapes.ConstraintViolationError: Constraints violated (seq_len)! For more information, run with TORCH_LOGS="+dynamic". - Not all values of seq_len = L['input_ids'].size()[1] in...

Hi @peri044 the code now goes past the above error points and also the python int overflow error. However I see this error now ``` Traceback (most recent call last):...

Hi @yjjinjie you can set the dynamic shapes and pass in the dynamic inputs using `torch_tensorrt.Input` something like ``` compile_spec = { "inputs": [ torch_tensorrt.Input( min_shape=(1, 3, 224, 224), opt_shape=(8,...

Yeah sure, let me take a look and get back on this.