sagemaker-debugger icon indicating copy to clipboard operation
sagemaker-debugger copied to clipboard

Keras example saving optimizer variables for step 0 but not step 10

Open rahul003 opened this issue 3 years ago • 1 comments

from tests.tensorflow.keras.test_keras import train_model
train_model(
        out_dir,
        save_all=True,
        use_tf_keras=True,
        save_config=SaveConfig(save_steps=[0, 10]),
        eager=False,
        steps=["train", "eval", "predict", "train"],
    )
print(create_trial_fast_refresh(out_dir).tensor_names(step=10))

rahul003 avatar Aug 19 '20 19:08 rahul003

step 0 ['RMSprop/decay:0', 'RMSprop/iter:0', 'RMSprop/learning_rate:0', 'RMSprop/momentum:0', 'RMSprop/rho:0', 'accuracy', 'batch', 'dense/weights/dense/bias:0', 'dense/weights/dense/kernel:0', 'dense_1/weights/dense_1/bias:0', 'dense_1/weights/dense_1/kernel:0', 'loss']

step 10 ['accuracy', 'batch', 'dense/weights/dense/bias:0', 'dense/weights/dense/kernel:0', 'dense_1/weights/dense_1/bias:0', 'dense_1/weights/dense_1/kernel:0', 'loss']

rahul003 avatar Aug 19 '20 19:08 rahul003