spacy-ray icon indicating copy to clipboard operation
spacy-ray copied to clipboard

Problem with saving model-best

Open gox6 opened this issue 4 years ago • 2 comments
trafficstars

The command spacy ray fails to save the model-best. Using just spacy it save the model-best. I get the same issue on Universal Dependencies Treebank example project.

Do you have any suggestion to solve this issue?

Fragment of my project.yml:

 - name: "train"
    help: "Train the request classification model"
    script:
      - "python -m spacy ray train configs/${vars.config} --output training/ --paths.train corpus/train.spacy --paths.dev corpus/val.spacy --nlp.lang ${vars.lang} --gpu-id ${vars.gpu_id}"
    deps:
      - "configs/${vars.config}"
      - "corpus/train.spacy"
      - "corpus/val.spacy"
    outputs:
      - "training/model-best"

gox6 avatar Jul 06 '21 13:07 gox6

It looks as saving the model with spacy-ray is not implemented yet: In train_cli.py there is the comment left: "# TODO: wire up output path".

Is it planned to be implemented in near future?

gox6 avatar Jul 07 '21 10:07 gox6

this seems like a fairly crucial feature

q-aaronzolnailucas avatar Feb 02 '23 16:02 q-aaronzolnailucas