genie-toolkit icon indicating copy to clipboard operation
genie-toolkit copied to clipboard

Training of Genie-Toolkit

Open vinith-reddy25 opened this issue 2 years ago • 1 comments

I ran the following command:

"$genie train --datadir data_dir --outputdir output_dir --workdir work_dir --config-file data/bert-lstm-single-sentence.json"

Folder structure of genie-toolkit is: "/genie-toolkit/data_dir" contains eval.tsv, and train.tsv "/genie-toolki/work_dir" -> empty "/genie-toolkit/output_dir" -> empty

It is giving following error

"0% [..............................] - ETA: 0s/home/shishirkumar/genie-toolkit/dist/tool/genie.js:41 throw up; ^ Error: Command exited with code 2 at ChildProcess. (/home/shishirkumar/genie-toolkit/dist/lib/utils/process-utils.js:91:28) at ChildProcess.emit (events.js:315:20) at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12)"

After adding "--debug", getting following error:

"

usage: genienlp [-h] {train,export,predict,server,cache-embeddings,train-paraphrase,run-paraphrase,calibrate,transform-dataset,clean-paraphrasing-dataset,dialog-to-tsv,split-dataset,sts-calculate-scores,sts-filter,bootleg-dump-features,analyze-bootleg-results,oracle-vs-bootleg,kfserver,write-kf-metrics} ... genienlp: error: unrecognized arguments: --seq2seq_encoder Identity --dimension 768 --transformer_hidden 768 --transformer_layers 0 --context_embeddings bert-base-uncased@0 --question_embeddings bert-base-uncased@1 --decoder_embeddings --trainable_encoder_embeddings 0 --transformer_lr_multiply 0.5 --train_context_embeddings --train_context_embeddings_after 80000 /home/shishirkumar/genie-toolkit/dist/tool/genie.js:41 throw up; ^

Error: Command exited with code 2 at ChildProcess. (/home/shishirkumar/genie-toolkit/dist/lib/utils/process-utils.js:91:28) at ChildProcess.emit (events.js:315:20) at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12) "

vinith-reddy25 avatar Jan 17 '22 04:01 vinith-reddy25

This tutorial needs some updates. We will keep you posted once we have a newer version.

sileix avatar Feb 02 '22 19:02 sileix