Glenn 'devalias' Grant

[xformers/benchmarks/benchmark_encoder.py] fatal error: cuda.h: No such file or directory + AttributeError: module 'triton' has no attribute 'code_gen'

6

# 🐛 Bug Trying to follow along with: - https://github.com/facebookresearch/xformers#testing-the-installation ``` /tmp/tmpzfde7mdr/main.c:2:10: fatal error: cuda.h: No such file or directory #include "cuda.h" ^~~~~~~~ compilation terminated. 0%| | 0/28 [00:01

### Is there an existing issue for this? - [X] I have searched the existing issues and checked the recent builds/commits ### What would your feature do ? - https://huggingface.co/docs/optimum/bettertransformer/overview...

Refactor StableDiffusion example scripts to use Optimum / BetterTransformer optimisations

1

**Describe the solution you'd like** StableDiffusion example scripts are updated to make use of the Optimum / BetterTransformer optimisations. **Describe alternatives you've considered** That the examples can't be integrated, or...

Integrate with ColossalAI for memory/speed efficiency and improvements

9

**WHAT** Integrate with ColossalAI for memory/speed efficiency and improvements. **WHERE** - https://github.com/hpcaitech/ColossalAI - > Colossal-AI: A Unified Deep Learning System for Big Model Era - https://medium.com/@yangyou_berkeley/diffusion-pretraining-and-hardware-fine-tuning-can-be-almost-7x-cheaper-85e970fe207b **HOW** - https://github.com/hpcaitech/ColossalAI/tree/main/examples/images/diffusion **WHEN**...

Explore NVIDIA/TransformerEngine for speed/efficiency

2

**Is your feature request related to a problem? Please describe.** A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] **Describe the solution you'd...

Add StableDiffusion Dreambooth example

2

Currently there are StableDiffusion examples here: - https://github.com/facebookincubator/AITemplate/tree/main/examples/05_stable_diffusion But it would be awesome if there was also examples of using this for Dreambooth: - https://dreambooth.github.io/ - https://github.com/huggingface/diffusers/tree/main/examples/dreambooth ## See also:...

Implement 'Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models'

7

Implement 'Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models' Basically allows fine grained image tweaks using 'sliders' - Paper: https://arxiv.org/abs/2311.12092 - > We present a method to create...

Integrate Set-of-Mark Visual Prompting for GPT-4V

7

I noticed that you currently seem to apply a grid to the images to assist the vision model: - https://github.com/OthersideAI/self-operating-computer/blob/main/operate/main.py#L462-L527 And mention this in the README: > **Current Challenges** >...

- https://developer.chrome.com/docs/extensions/reference/api/sidePanel - > Use the `chrome.sidePanel` API to host content in the browser's side panel alongside the main content of a webpage. > > The Side Panel API allows...

- eg. https://github.com/kanban-labs/tabs-count - > This is a simple browser extension that lets you know the amount of tabs you have open. The code is very lightweight and only runs...