xformers icon indicating copy to clipboard operation
xformers copied to clipboard

Hackable and optimized Transformers building blocks, supporting a composable construction.

Results 158 xformers issues
Sort by recently updated
recently updated
newest added

# ❓ Questions and Help I am working on a Unity project that seems pretty heavily integrated with cuda 11.7, and I don't know how hard it would be to...

# πŸ› Bug ## Command ## To Reproduce Steps to reproduce the behavior: Theres a issue everytime i delete my folder, and start fresh the python numner changes, from 3.9.13,...

# ❓ Questions and Help I have received the following error and would like to ask how to install Xformer that supports Torch 1.13.0 version. `` warnings.warn( 2023-10-16 15:05:49 |...

# Support Backward in RMSNorm hello, It seems that we can't use RMSNorm with a backward pass (see code [here](https://github.com/facebookresearch/xformers/blob/042abc8aa47d1f5bcc2e82df041811de218924ba/xformers/ops/rmsnorm.py#L37C27-L37C36) ) I was wondering if you plan to support it...

Am compiling on linux, cuda 11.8 for arch 60,61,86. I did a git submodule update and pulled latest cutlass and flash attention. Compile now failed on bfloat16.h (94) and the...

`save-state` and `set-output` commands used in GitHub Actions are deprecated and [GitHub recommends using environment files](https://github.blog/changelog/2023-07-24-github-actions-update-on-save-state-and-set-output-commands/). This PR updates the usage of `set-output` to `$GITHUB_OUTPUT` Instructions for envvar usage from...

CLA Signed

I have seen many users in the community encounter compilation and build problems, and many failures, especially when using new versions of CUDA, PyTorch, or wanting to update CUTLASS or...

# ❓ Questions and Help Hello! I made new VM in google with Tesla L4 that is supported only CUDA 12. Now I want to use from Xformers for DreamBooth...

# ❓ Questions and Help ![image](https://github.com/facebookresearch/xformers/assets/55701610/defa2895-6f48-4c90-a251-c6319736896a) I get the above error when I use ninja to compile xformers. And when I don’t use ninja, I can compile normally. Is there...