xformers

xformers copied to clipboard

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * __->__ #540 * #539

danthe3rd

Improve build time by ~30%

1

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #540 * __->__ #539 ... by reducing the number of ATen imports, and skipping them altogether when building the actual kernels 13mn ->...

danthe3rd

Making built wheels available for install

11

# 🚀 Feature ## Motivation After #523 #534, the wheels can be built, but are not available for install anywhere. But users want this #532 #473 ## Pitch & Alternatives...

AbdBarho

Add Triton Flash Attention

6

## What does this PR do? Adds Triton Flash Attention Performance Compared to Vanilla ``` [--------- attention (attn_bias=) --------] | optimized | vanilla 1 threads: -------------------------------------------------- f16 B=384, M=197, H=1,...

dianaml0

Meet error when using xformers and doing loss backward

3

# 🐛 Bug Associated issue: https://github.com/huggingface/diffusers/issues/1314 Get error when I enable xformers of UNet and try to do backward: ``` Traceback (most recent call last): File "f:/diffusers-test/vae_expr.py", line 66, in...

eeyrw

Support pure pytorch implementation for memory_efficient_attention

4

# 🚀 Feature I found that `memory_efficient_attention` op does not support pure pytorch implementation (e.g. without using device specific op, or library or cython). The current implementations fail to dispatch...

hoangmit

Flexible GATE in MOE layer

2

# 🚀 Feature Would like have a flexible MOE layer with ability to choose configurable no of Gates. ## Motivation Currently only TOP2Gate is supported. Can we have generic version...

oneraghavan

[xformers/benchmarks/benchmark_encoder.py] fatal error: cuda.h: No such file or directory + AttributeError: module 'triton' has no attribute 'code_gen'

6

# 🐛 Bug Trying to follow along with: - https://github.com/facebookresearch/xformers#testing-the-installation ``` /tmp/tmpzfde7mdr/main.c:2:10: fatal error: cuda.h: No such file or directory #include "cuda.h" ^~~~~~~~ compilation terminated. 0%| | 0/28 [00:01

0xdevalias

Pip installation failing with 'command '/usr/local/cuda/bin/nvcc' failed with exit code 255'

10

# 🐛 Bug Pip installation fails on Amazon EC2 Instance (Amazon Linux) with confusing error: `command '/usr/local/cuda/bin/nvcc' failed with exit code 255` ## Command To install, I do the following:...

BenjaminIrwin

Support for `pip`

1

I really love Conda, is amazing but not all workflows work with that. (e.g.: Google Colab and others). Installing the package without conda (building or pre-built wheels) is very slow...

apolinario