composer
composer copied to clipboard
Check ckpt dir exists before checking for metadata file in legacy sharding check
trafficstars
What does this PR do?
Bug where if user misspecified load_path and it did not exist, then .metadata file would not exist and then composer would think it was legacy sharded checkpoint.
This fix checks existence of dir/prefix in object store first and then fails fast