Zhang Miaochang

I wrote a simple test code which can not run on a single GPU because of OOM, but runs well using deepspeed on 4 GPUs. The networks is built by...

代码中有地方不明白，为什么这么处理

1

为什么： https://github.com/levihsu/OOTDiffusion/blob/main/ootd/pipelines_ootd/pipeline_ootd.py#L586 > if ... ... max_length = prompt_embeds.shape[1] uncond_input = self.tokenizer( uncond_tokens, padding="max_length", max_length=max_length, truncation=True, return_tensors="pt", ) if hasattr(self.text_encoder.config, "use_attention_mask") and self.text_encoder.config.use_attention_mask: attention_mask = uncond_input.attention_mask.to(device) else: attention_mask = None...

in file training/training_loop_fullbody.py: the yellow colored line repeats twice. why?