xformers icon indicating copy to clipboard operation
xformers copied to clipboard

Hackable and optimized Transformers building blocks, supporting a composable construction.

Results 158 xformers issues
Sort by recently updated
recently updated
newest added

# πŸ› Bug When try to install xformers from pip, the installation frozeen to 100% of CPU for > 30 minutes (I stopped it before finish) ## Command ## To...

# ❓ Questions and Help the below command installs torch 2.0 but I want to use the torch that I have which is 1.11.0+cu113. I dont want the torch version...

# ❓ Questions and Help Is there a way to install Xformers with CUDA 12? I'm trying to use Xformers on a Singularity image that employs, as a base, an...

cutlass 3.2.1 flash-attention 2.3.2 ============= flash-attention V2 can be work on WINDOWS from 2.3.2(need CUDA 12οΌ‰

# πŸ› Bug ## Command pip install -v -U git+https://github.com/facebookresearch/xformers.git@main#egg=xformers ## To Reproduce Steps to reproduce the behavior: C:\Users\joker\OneDrive\Desktop\A.I\xformers\Scripts>C:\Users\joker\OneDrive\Desktop\A.I\xformers\Scripts\activate (xformers) C:\Users\joker\OneDrive\Desktop\A.I\xformers\Scripts>pip show torch Name: torch Version: 2.1.0+cu121 Summary: Tensors and...

Related issue: https://github.com/huggingface/diffusers/issues/5368 When using PyTorch 2.1 and the latest stable build of xformers, our [DreamBooth LoRA script for SDXL](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_sdxl.md) doesn't work. https://github.com/huggingface/diffusers/issues/5368 provides more details. But when using SDPA...

# πŸ› Bug Even when Flash Attention and Cutlass are already installed, xformers setup.py attempts and fails to complete building of flash_attn rather than properly recognizing then as already installed....

## Command pip install -v -U git+https://github.com/facebookresearch/xformers.git@main#egg=xformers ## To Reproduce attempt to install from source ## Environment - PyTorch Version (e.g., 1.0): 2.1.0+cu121 - OS (e.g., Linux): Microsoft Windows 11...

# ❓ Questions and Help ![D O3$)BN76Z~UM3}POM7}EV](https://github.com/facebookresearch/xformers/assets/155218424/acdf7371-15c8-4b76-a76a-0247b75a3811) lida 0.0.10 requires kaleido, which is not installed. tensorflow-probability 0.22.0 requires typing-extensions

Nvidia pytorch docker images is very easy to use, but it haven't a suitable version for xformers. could you support for nvidia pytorch docker images? https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/index.html