AITemplate

AITemplate copied to clipboard

Add cast operator

1

Summary: Building a simple AIT cast operator that supports `float16`, `bfloat16`, and `float32`. This first version does not support Vectorization in order to simplify this task Differential Revision: D46603937

koudev

ver 2

neonsecret

# Description Currently `compile_alt.py` generates bad images on T4 GPU (SM75). Related issue - https://github.com/facebookincubator/AITemplate/issues/781 Notebook to reproduce the issue with bad images on T4 GPU - [AIT_alt_bad_image.ipynb](https://colab.research.google.com/drive/1XBupsnP35rJ-3mKheBQVjNfjy1nTcjuO?usp=sharing) I found...

apivovarov

Save all generated images in SD `demo_alt.py` script. This was fixed in `demo.py` already couple days ago.

apivovarov

stable_diffusion alt example generates bad images on T4 GPU (sm 7.5)

4

I tried to use `compile_alt` and `demo_alt` to compile and run stable_diffusion model on T4 GPU (sm 7.5) The generated image is a mess - Example - [bad image 1](https://ibb.co/pb7B0C5)...

apivovarov

Add variable batch to SD compilation

1

## Description This PR allows to compile SD pipeline with variable batch size. H and W are fixed and defined by the model variant. (base - 512 and regular -...

apivovarov

include cstdint for int*_t in profiler

4

The conv2d profiler can be built well with gcc-12. But, when switching to gcc-13, compilation failed with error listed below. This error may caused by reduced usage of cstdint header...

chengscott

Range operator lowering minimizer

1

Summary: During our perf tuning, we are seeing mtml_instagram_model lag behind AIT around 23% on mergenet (525662456/1670) How do we compare the perf between AIT and AOTI? Refering the idea...

frank-wei

Summary: as title, there are still some utilities functions needed from fx2ait for aot_Inductor_lower before we fully moved everything to PT2 full stack Reviewed By: chenyang78 Differential Revision: D56613348

zoranzhao

I haven't been able to get grouped ConvTranspose to work correctly. I added a unittest for it here https://github.com/jonpryai/AITemplate_Upstream/commit/47421490c3cec2047328b45d63f5ff3a451efc53 Which fails with a segfault. Any ideas?

jonpryai