commonvoice-fr icon indicating copy to clipboard operation
commonvoice-fr copied to clipboard

Fix `best_dev_checkpoint` path

Open wasertech opened this issue 1 year ago • 0 comments

Produced checkpoints are using absolute path where they should really be using relative ones.

Checkpoints FR STT 0.9

# ./best_dev_checkpoint
model_checkpoint_path: "/mnt/checkpoints/best_dev-221133"
all_model_checkpoint_paths: "/mnt/checkpoints/best_dev-221133"

Here is English checkpoint for reference.

# ./best_dev_checkpoint
model_checkpoint_path: "best_dev-3663881"
all_model_checkpoint_paths: "best_dev-3663881"

Fix should probably go into package.sh I think.

Related : https://github.com/coqui-ai/STT/issues/2338 ^ STT's lm_optimizer throws a NotFoundError from TF, since the path points to nowhere in transfer-learning configuration, as checkpoint path is /transfer-checkpoint/ instead of /mnt/checkpoints/. https://github.com/common-voice/commonvoice-fr/blob/5699e59244d14bb14d5b7603b91c934b761c9194/DeepSpeech/CONTRIBUTING.md?plain=1#L76-L78 https://github.com/common-voice/commonvoice-fr/blob/5699e59244d14bb14d5b7603b91c934b761c9194/DeepSpeech/train.sh#L14-L17

That was for DS but with STT, we have access to --load_checkpoint_dir and --save_checkpoint_dir flags instead.

	if [ -f "/transfer-checkpoint/checkpoint" -a ! -f "/mnt/models/output_graph.tflite" ]; then
		echo "Using checkpoint from ${TRANSFER_CHECKPOINT}"
		# use --load_checkpoint_dir for transfer learning
		LOAD_CHECKPOINT_FROM="--load_checkpoint_dir /transfer-checkpoint --save_checkpoint_dir /mnt/checkpoints"
	else
		LOAD_CHECKPOINT_FROM="--checkpoint_dir /mnt/checkpoints/"
	fi;

Example from my branch stt140-cv9

wasertech avatar Jan 29 '23 06:01 wasertech