tutorials icon indicating copy to clipboard operation
tutorials copied to clipboard
verified publisher icon pytorch

[BUG] - Depracate the usage of Nested Tensors

Open svekars opened this issue 4 days ago • 0 comments

Add Link

intermediate_source/transformer_building_blocks.py unstable_source/nestedtensor.py https://github.com/pytorch/pytorch/issues/171814

Describe the bug

intermediate_source/transformer_building_blocks.py

We need to depracate the usage of NestedTensors in all tutorials and replace with varlen attention. We put a warning to not use them but we should provide what should be used instead.

Describe your environment

  • PyTorch 2.10

cc @albanD @jbschlosser

svekars avatar Jan 16 '26 19:01 svekars