TensorRT

TensorRT copied to clipboard

RuntimeError: Variable 'x' previously had type Tensor but is now being assigned to a value of type List[Tensor]

1

Load checkpoint from: wav2lip_checkpoint/checkpoint_step002680000.pth 0%| | 0/22 [01:37

dizhenx

How to set the input when compiling model for non-image input?

1

Hi, I have trained a model whose input is a set of 3D points with a shape `Nx3`, N is not a fixed number. In this case, how to set...

DeepDuke

Update `enforce_tensor_types` to function with more granular typing

2

- Rename to `enforce_types` - Allow `(int, float, bool)` type requirements - Allow typing of tensor data to streamline casting

gs-olive

- Pretty-Print Compilation Settings - Add Torch subgraph blocks for fast partitioner at least See https://github.com/pytorch/TensorRT/pull/2451#pullrequestreview-1787640029 See also: https://github.com/pytorch/TensorRT/pull/2451#discussion_r1433077927

gs-olive

Port #2445 to apply to TorchScript path. Requires enablement of an additional (optional) compile-time argument in TorchScript and builder flag in TensorRT

gs-olive

❓[Question] The only valid use of a module is looking up an attribute but found...

5

## ❓ Question Hello, I have a torch scripted model that I am trying to compile with TensorRT: ```py import cv2 import numpy as np import torch from torchvision.transforms import...

edmuthiah

narendasan

Bumps [transformers](https://github.com/huggingface/transformers) from 4.33.2 to 4.36.0. Release notes Sourced from transformers's releases. v4.36: Mixtral, Llava/BakLlava, SeamlessM4T v2, AMD ROCm, F.sdpa wide-spread support New model additions Mixtral Mixtral is the new...

dependabot[bot]

❓ [Question] Is it possible to export unet's tensorrt engine as a file in stable diffusion?

1

## ❓ Question Hello. I am currently trying to infer the stable diffusion XL inpaint model using your package. model link : https://huggingface.co/diffusers/stable-diffusion-xl-1.0-inpainting-0.1 I referred to your example code and...

0-chan-kor

feat: support 1d ITensor offsets for embedding_bag converter

2

# Description Support 1d ITensor offsets for embedding_bag converter. Note that this is only for 1d inputs. There's a bug that same offsets with different types (tensor or ITensor) when...

zewenli98