Ryan
Ryan
Thanks @chenhsuanlin Is there any recommended range for `RESOLUTION`? for example any number from 2048 to 8192 as long as it's the multiple of 2?
@chenhsuanlin I tried out your suggestion to set `RESOLUTION=4096 `and `BLOCK_RES=32` to extract the surface for a 40 secs video. Initially, the estimated time to complete is around 4 hours...
> Yes! we are def going multimodal, I've tested yet but it could work already, that said I want to have a better DSL around it. Marking this as feature...
hi @kitmallet Happy New Year. It's amazing to see the 3DS converted to OBJ and displayed in Blender on Windows. I can't wait to see you sharing your experience, do...
Hi @byshiue Thanks for looking at this issue. Now I know the `world_size` should be `tp_size x pp_size` which are the parameters used in build-engine script. I changed the world-size...
oops, I made a mistake on the parameter in config.pbtxt, after fixing that bug I could launch Triton successfully.
Hi @byshiue Just to confirm with you what is the right approach to decide `world_size` if multi GPUs are used? With all the setup remaining the same as above, I...
> what's your transformers version? root@7995db4e1845:/srv/tensorrtllm_backend# pip show transformers Name: transformers **Version: 4.42.4** Summary: State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow Home-page: https://github.com/huggingface/transformers Author: The Hugging Face team (past...
thanks @nv-guomingz After upgrading the transformers version, I got an different error saying `safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge` Here is the steps of reproduction: **Update transformers version to 4.43.dev0+**...
> Is it possible to run cmd `pip install --upgrade safetensors` and then run quantization again? I can't reproduce your issue on my side with the cmd you provided. my...