BigDL-2.x icon indicating copy to clipboard operation
BigDL-2.x copied to clipboard

Orca TF2 estimator cannot load tf savedmodel directly

Open cyita opened this issue 4 years ago • 1 comments

I load tf savedmodel using

def model_creator(config):
    item_model = keras.models.load_model("/opt/work/guoqiong/friesian_embed/Training/Embedding/2tower_models/exp5/item-model", custom_objects={'tf':tf})
    optimizer = tf.keras.optimizers.Adam(config["lr"])
    item_model.compile(optimizer=optimizer, loss='binary_crossentropy', metrics=['binary_accuracy', 'binary_crossentropy', 'AUC'])
    return item_model

est = Estimator.from_keras(model_creator=model_creator, verbose=False, config=config)

And every node should have a copy of this savedmodel. Orca TF2 estimator may add a function that loads tf savedmodel directly.

cyita avatar Aug 05 '21 02:08 cyita

an idea, can you try to load the model locally, and put it into config? config["mode"] = keras.models.load_model("/opt/work/guoqiong/friesian_embed/Training/Embedding/2tower_models/exp5/item-model", custom_objects={'tf':tf}) def model_creator(config): item_model = config["model"] return item_model

songhappy avatar Aug 05 '21 23:08 songhappy