Longxu Dou

Thanks for your quick reply! A1: The db_id of the above three examples are `wta_1`, `singer`, `orchestra` respectively. A2: For T5-large, **61 incomplete sql in dev (1034 in total)**. I...

And when I am using the same input/output format like yours, there are still some incomplete sql. CLICK ME > show all template type codes with less than three templates....

> > And when I am using the same input/output format like yours, there are still some incomplete sql. > > Thanks, can you provide a continuations that the model...

Since the log file is a little long, I paste the log in [Google doc](https://docs.google.com/document/d/1j7vCfzrEhvQ9BRFx5ScdJqvUardgMpn9iBr93iQ2oR8/edit?usp=sharing). You can edit it as you want. If you need further information, please let me...

@tscholak Thanks! But I find that the latest docker images `docker pull tscholak/text-to-sql-eval:c4c9a08965cfa01a4c0773a8f67687b33409836f` or `docker pull tscholak/text-to-sql-eval:cache` would throw out the error: ``` File "/opt/conda/lib/python3.7/site-packages/transformers/trainer_seq2seq.py", line 177, in prediction_step **gen_kwargs,...

@tscholak It works now. But prediction becomes much slower, is that normal? `t5-base` with batch-size = `20` on docker `cache`.

@tscholak FYI, in the first 10% eval data, it's okay (shows that the eval time will be ~4 mins as before). But after that, the prediction will be stuck and...

@tscholak It works now by clean the docker. Thank you very much for your help in this issue :) You really help me a lot on this!

@tscholak I observe that (1) after reboot the server and cleaning the docker cache, it will predict in the normal prediction speed under your setting (2) as for my output...

And if I want to change the haskell code to build my own picard server. (I want to do debug job to push my project more fast.) What's the workflow...