Missing control images for QwenImageEditPlusModel
config :
job: "extension" config: name: "my_first_lora_v1" process: - type: "diffusion_trainer" training_folder: "/workspace/GOKCEM/qwen-image/ai-toolkit/output" sqlite_db_path: "./aitk_db.db" device: "cuda" trigger_word: null performance_log_every: 10 network: type: "lora" linear: 32 linear_alpha: 32 conv: 16 conv_alpha: 16 lokr_full_rank: true lokr_factor: -1 network_kwargs: ignore_if_contains: [] save: dtype: "bf16" save_every: 250 max_step_saves_to_keep: 4 save_format: "diffusers" push_to_hub: false datasets: - folder_path: "/workspace/GOKCEM/qwen-image/ai-toolkit/datasets/target" mask_path: null mask_min_value: 0.1 default_caption: "" caption_ext: "txt" caption_dropout_rate: 0.05 cache_latents_to_disk: false is_reg: false network_weight: 1 resolution: - 512 - 768 - 1024 controls: [] shrink_video_to_frames: true num_frames: 1 do_i2v: true flip_x: false flip_y: false control_path_1: "/workspace/GOKCEM/qwen-image/ai-toolkit/datasets/control_img" control_path_2: "/workspace/GOKCEM/qwen-image/ai-toolkit/datasets/target" control_path_3: null train: batch_size: 1 bypass_guidance_embedding: false steps: 3000 gradient_accumulation: 1 train_unet: true train_text_encoder: false gradient_checkpointing: true noise_scheduler: "flowmatch" optimizer: "adamw8bit" timestep_type: "weighted" content_or_style: "balanced" optimizer_params: weight_decay: 0.0001 unload_text_encoder: false cache_text_embeddings: false lr: 0.0001 ema_config: use_ema: false ema_decay: 0.99 skip_first_sample: false force_first_sample: false disable_sampling: true dtype: "bf16" diff_output_preservation: false diff_output_preservation_multiplier: 1 diff_output_preservation_class: "person" switch_boundary_every: 1 loss_type: "mse" model: name_or_path: "Qwen/Qwen-Image-Edit-2509" quantize: false qtype: "qfloat8" quantize_te: false qtype_te: "qfloat8" arch: "qwen_image_edit_plus" low_vram: true model_kwargs: match_target_res: false layer_offloading: false layer_offloading_text_encoder_percent: 1 layer_offloading_transformer_percent: 1 sample: sampler: "flowmatch" sample_every: 250 width: 1024 height: 1024 samples: [] neg: "" seed: 42 walk_seed: true guidance_scale: 4 sample_steps: 25 num_frames: 1 fps: 1 meta: name: "[name]" version: "1.0"
Result:
- 0 completed jobs
- 1 failure
========================================
Traceback (most recent call last):
File "/workspace/GOKCEM/qwen-image/ai-toolkit/run.py", line 120, in
main() File "/workspace/GOKCEM/qwen-image/ai-toolkit/run.py", line 108, in main raise e File "/workspace/GOKCEM/qwen-image/ai-toolkit/run.py", line 96, in main job.run() File "/workspace/GOKCEM/qwen-image/ai-toolkit/jobs/ExtensionJob.py", line 22, in run process.run() File "/workspace/GOKCEM/qwen-image/ai-toolkit/jobs/process/BaseSDTrainProcess.py", line 2154, in run loss_dict = self.hook_train_loop(batch_list) File "/workspace/GOKCEM/qwen-image/ai-toolkit/extensions_built_in/sd_trainer/SDTrainer.py", line 2024, in hook_train_loop loss = self.train_single_accumulation(batch) File "/workspace/GOKCEM/qwen-image/ai-toolkit/extensions_built_in/sd_trainer/SDTrainer.py", line 1550, in train_single_accumulation conditional_embeds = self.sd.encode_prompt( File "/workspace/GOKCEM/qwen-image/ai-toolkit/toolkit/models/base_model.py", line 1069, in encode_prompt return self.get_prompt_embeds(prompt, control_images=control_images) File "/workspace/GOKCEM/qwen-image/ai-toolkit/extensions_built_in/diffusion_models/qwen_image/qwen_image_edit_plus.py", line 170, in get_prompt_embeds raise ValueError("Missing control images for QwenImageEditPlusModel") ValueError: Missing control images for QwenImageEditPlusModel Traceback (most recent call last): File "/workspace/GOKCEM/qwen-image/ai-toolkit/run.py", line 120, in main() File "/workspace/GOKCEM/qwen-image/ai-toolkit/run.py", line 108, in main raise e File "/workspace/GOKCEM/qwen-image/ai-toolkit/run.py", line 96, in main job.run() File "/workspace/GOKCEM/qwen-image/ai-toolkit/jobs/ExtensionJob.py", line 22, in run process.run() File "/workspace/GOKCEM/qwen-image/ai-toolkit/jobs/process/BaseSDTrainProcess.py", line 2154, in run loss_dict = self.hook_train_loop(batch_list) File "/workspace/GOKCEM/qwen-image/ai-toolkit/extensions_built_in/sd_trainer/SDTrainer.py", line 2024, in hook_train_loop loss = self.train_single_accumulation(batch) File "/workspace/GOKCEM/qwen-image/ai-toolkit/extensions_built_in/sd_trainer/SDTrainer.py", line 1550, in train_single_accumulation conditional_embeds = self.sd.encode_prompt( File "/workspace/GOKCEM/qwen-image/ai-toolkit/toolkit/models/base_model.py", line 1069, in encode_prompt return self.get_prompt_embeds(prompt, control_images=control_images) File "/workspace/GOKCEM/qwen-image/ai-toolkit/extensions_built_in/diffusion_models/qwen_image/qwen_image_edit_plus.py", line 170, in get_prompt_embeds raise ValueError("Missing control images for QwenImageEditPlusModel") ValueError: Missing control images for QwenImageEditPlusModel
+1
+1
Found that I could get 2509 running by ticking cache_text_embeddings: true when encountering this error
Found that I could get 2509 running by ticking
cache_text_embeddings: truewhen encountering this error
Also it works for me , thank you for reply
Found that I could get 2509 running by ticking
cache_text_embeddings: truewhen encountering this error
worked for me!