CoOp
CoOp copied to clipboard
Config Optimizer Overwritten
I have tried to change the optimizer attributes to an ADAM optimizer with different LR scheduling and ADAM specific parameters, but when run, it overwrites the LR Scheduler parameters and the betas.
The config file:
DATALOADER:
TRAIN_X:
BATCH_SIZE: 8
TEST:
BATCH_SIZE: 100
NUM_WORKERS: 4
INPUT:
SIZE: (224, 224)
INTERPOLATION: "bicubic"
PIXEL_MEAN: [0.48145466, 0.4578275, 0.40821073]
PIXEL_STD: [0.26862954, 0.26130258, 0.27577711]
TRANSFORMS: ["random_resized_crop", "random_flip", "normalize"]
OPTIM:
NAME: "adam"
LR: 0.0002
ADAM_BETA1: 0.5
ADAM_BETA2: 0.999
MAX_EPOCH: 100
LR_SCHEDULER: "single_step"
GAMMA: 0.1
STEPSIZE: 0
WARMUP_EPOCH: 0
WARMUP_TYPE: "constant"
WARMUP_CONS_LR: 1e-5
TRAIN:
PRINT_FREQ: 20
MODEL:
BACKBONE:
NAME: "videoclip"
TRAINER:
COCOOP:
N_CTX: 4
CTX_INIT: ''
PREC: 'amp'
The log output once run:
OPTIM:
ADAM_BETA1: 0.9
ADAM_BETA2: 0.999
BASE_LR_MULT: 0.1
GAMMA: 0.1
LR: 0.0003
LR_SCHEDULER: single_step
MAX_EPOCH: 10
MOMENTUM: 0.9
NAME: adam
NEW_LAYERS: ()
RMSPROP_ALPHA: 0.99
SGD_DAMPNING: 0
SGD_NESTEROV: False
STAGED_LR: False
STEPSIZE: (-1,)
WARMUP_CONS_LR: 1e-05
WARMUP_EPOCH: -1
WARMUP_MIN_LR: 1e-05
WARMUP_RECOUNT: True
WARMUP_TYPE: linear
WEIGHT_DECAY: 0.0005
Is this a problem with DASSL or a problem with the CoCoOp code base?
Thanks!
Fixed, was a bug in how I was passing config.