Feat: Wandb logging

[p1atdev]

I added wandb integration to monitor the training. Loss and sample image logging are supported.

Example config:

job: extension
config:
  name: "my_first_flux_lora_v1"
  process:
    - type: 'sd_trainer'
      training_folder: ...
      ... # other config
      # logging config
      logging: 
        use_wandb: true # enable wandb by this flag
        project_name: my_flux_lora_style_1 # default is "ai-toolkit"
        run_name: "first_try" # empty here to use random generated name by wandb

[p1atdev]

I have found that the logging does not follow the logging.log_every parameter, so I have to fix that.

[jaretburkett]

Thank you. I'll go through and test all of this in the next few days when I get a chance.

[robertvoy]

Does this work? Or is there a way to get a log for the loss currently?

[khronimo]

Hope this gets merged. Wandb logging would be nice to have

[davidattias]

What's the status on this one? I would love to use it as well....

[WetOnTheWater]

@jaretburkett any luck on testing? Oddly enough noticed that this trainer on Replicate supports it but not officially here yet

[jaretburkett]

Sorry this took so long. Thank you @p1atdev

[davidattias]

Awesome! Thank you @jaretburkett @p1atdev

[terrificdm]

No need to fill out Wandb authentication？

[Xqua]

No need to fill out Wandb authentication？

You need to pip install wandb and then wandb login