nl2bash icon indicating copy to clipboard operation
nl2bash copied to clipboard

How can I reproduce the Paper result?

Open r06921078 opened this issue 5 years ago • 4 comments

r06921078 avatar Mar 31 '19 11:03 r06921078

How can I reproduce the Paper result?

r06921078 avatar Mar 31 '19 11:03 r06921078

Have you try following the instructions in the README?

If you met any specific problems, please post them here.

todpole3 avatar Apr 01 '19 03:04 todpole3

Hi:

Yes, I clone this repo and follow the "Run Experiments" steps,(I didn't modify any hyper parameters in this repo) but I got the result in dev is not reach the Accuracy in paper, Can you help me find out the question? Very thank you.

Kang

Victoria X Lin [email protected] 於 2019年4月1日 週一 上午11:43寫道:

Have you try following the instructions in the README?

If you met any specific problems, please post them here.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/TellinaTool/nl2bash/issues/15#issuecomment-478425032, or mute the thread https://github.com/notifications/unsubscribe-auth/Ad7hAEwgZyYF7r9SWQObRkctdBVMtt-bks5vcYBJgaJpZM4cUP9y .

r06921078 avatar Apr 01 '19 07:04 r06921078

Ah, please check if it is the automatic evaluation metrics that does not match the published results or it is the manual evaluation metrics.

If only the manual evaluation metrics does not match those in the paper, you might be experiencing the same issue as #6.

todpole3 avatar Apr 04 '19 18:04 todpole3