CoOp icon indicating copy to clipboard operation
CoOp copied to clipboard

Config Optimizer Overwritten

Open Maddy12 opened this issue 1 year ago • 1 comments

I have tried to change the optimizer attributes to an ADAM optimizer with different LR scheduling and ADAM specific parameters, but when run, it overwrites the LR Scheduler parameters and the betas.

The config file:

DATALOADER:
  TRAIN_X:
    BATCH_SIZE: 8
  TEST:
    BATCH_SIZE: 100
  NUM_WORKERS: 4

INPUT:
  SIZE: (224, 224)
  INTERPOLATION: "bicubic"
  PIXEL_MEAN: [0.48145466, 0.4578275, 0.40821073]
  PIXEL_STD: [0.26862954, 0.26130258, 0.27577711]
  TRANSFORMS: ["random_resized_crop", "random_flip", "normalize"]

OPTIM:
  NAME: "adam"
  LR: 0.0002
  ADAM_BETA1: 0.5
  ADAM_BETA2: 0.999
  MAX_EPOCH: 100
  LR_SCHEDULER: "single_step"
  GAMMA: 0.1
  STEPSIZE: 0
  WARMUP_EPOCH: 0
  WARMUP_TYPE: "constant"
  WARMUP_CONS_LR: 1e-5

TRAIN:
  PRINT_FREQ: 20

MODEL:
  BACKBONE:
    NAME: "videoclip"

TRAINER:
  COCOOP:
    N_CTX: 4
    CTX_INIT: ''
    PREC: 'amp'

The log output once run:

OPTIM:
  ADAM_BETA1: 0.9
  ADAM_BETA2: 0.999
  BASE_LR_MULT: 0.1
  GAMMA: 0.1
  LR: 0.0003
  LR_SCHEDULER: single_step
  MAX_EPOCH: 10
  MOMENTUM: 0.9
  NAME: adam
  NEW_LAYERS: ()
  RMSPROP_ALPHA: 0.99
  SGD_DAMPNING: 0
  SGD_NESTEROV: False
  STAGED_LR: False
  STEPSIZE: (-1,)
  WARMUP_CONS_LR: 1e-05
  WARMUP_EPOCH: -1
  WARMUP_MIN_LR: 1e-05
  WARMUP_RECOUNT: True
  WARMUP_TYPE: linear
  WEIGHT_DECAY: 0.0005

Is this a problem with DASSL or a problem with the CoCoOp code base?

Thanks!

Maddy12 avatar Sep 23 '22 17:09 Maddy12

Fixed, was a bug in how I was passing config.

Maddy12 avatar Sep 23 '22 19:09 Maddy12