llm-foundry icon indicating copy to clipboard operation
llm-foundry copied to clipboard

make triton attn req pre-mlri tagged triton

Open vchiley opened this issue 2 years ago • 1 comments

I fork triton and rename it at triton_pre_mlri, triton diff here

llmfoundry/models/layers/flash_attn_triton.py is copy pasta from HazyResearch flash_attn_triton where I modify imports to be

import triton_pre_mlir as triton
import triton_pre_mlir.language as tl

This PR will be used as a springboard to test torch2 updt

vchiley avatar May 16 '23 20:05 vchiley

~~blocking composer pr (waiting for updt img): https://github.com/mosaicml/composer/pull/2229~~ merged

vchiley avatar May 17 '23 01:05 vchiley

This is integrated into https://github.com/mosaicml/llm-foundry/pull/149 closing in favor of that PR.

vchiley avatar May 19 '23 15:05 vchiley