tutorials
tutorials copied to clipboard
pytorch
PyTorch tutorials.
## Description Migrate `advanced_source/cpp_custom_ops.rst` to libtorch stable ABI/API. Accompanying change to [`extension-cpp`](https://github.com/pytorch/extension-cpp/pull/126) ## Checklist - [ ] The issue that is being fixed is referred in the description (see above...
This PR is a tutorial for a variable length attention API
Context: https://github.com/pytorch/pytorch/issues/112398#issuecomment-3745637813 Supersedes #3724
update the tutorial with windows support cc @jgong5 @mingfeima @XiaobingSuper @sanchitintel @ashokei @jingxu10 @ZailiWang @leslie-fang-intel @Xia-Weiwen @sekahler2 @CaoE @zhuhaozhe @Valentine233
### Add Link intermediate_source/transformer_building_blocks.py unstable_source/nestedtensor.py https://github.com/pytorch/pytorch/issues/171814 ### Describe the bug intermediate_source/transformer_building_blocks.py We need to depracate the usage of NestedTensors in all tutorials and replace with varlen attention. We put a...
Add layout=torch.jagged parameter to nested_tensor call to suppress the prototype API warning and use the recommended jagged layout. ## Checklist - [ ] Only one issue is addressed in this...
## Summary - Add new section demonstrating `flex_attention` from PyTorch 2.5 - Include `score_mod` examples: relative position bias and ALiBi - Show `block_mask` for sparse attention patterns (causal masking) -...