Sam Bond-Taylor

icon indicating a website link https://samb-t.github.io/

icon company @Microsoft icon location Cambridge icon location Senior Researcher in Health Futures at Microsoft Research Cambridge. Previously PhD in deep generative models at Durham University.

Results 2 comments of Sam Bond-Taylor

the `attention_head_dim` argument for `UNet2DConditionModel`

Hi, this doesn't seem to have been fixed. In `UNet2DConditionModel` the parameter `attention_head_dim` (described in the docs as "The dimension of the attention heads.") actually changes the number of heads,...

the `attention_head_dim` argument for `UNet2DConditionModel`

I think where the confusion must have come from is that in the stable diffusion repo, the number of heads is fixed to 8 all through the UNet, e.g. [here](https://github.com/CompVis/stable-diffusion/blob/main/configs/stable-diffusion/v1-inference.yaml#L39)....