HazyResearch
Can't run 'do sentences' in spouse example
I get the following error while running 'do sentences' while using v0.8.x:
‘run/RUNNING’ -> ‘20180102/144348.236896357’
‘run/LATEST’ -> ‘20180102/144348.236896357’
2018-01-02 14:43:51.099501 # on machine-learning-experimental-2: deepdive do sentences
2018-01-02 14:43:51.101989 # run/20180102/144348.236896357/plan.sh
2018-01-02 14:43:51.103923 # execution plan for data/sentences
2018-01-02 14:43:51.104013
2018-01-02 14:43:51.104036 : ## process/init/app ##########################################################
2018-01-02 14:43:51.104278 : # Done: 2017-12-30T11:10:56+0000 (3d 3h 32m 52s ago)
2018-01-02 14:43:51.104308 : process/init/app/run.sh
2018-01-02 14:43:51.104544 : mark_done process/init/app
2018-01-02 14:43:51.104581 : ##############################################################################
2018-01-02 14:43:51.104603
2018-01-02 14:43:51.104624
2018-01-02 14:43:51.104644 : ## process/init/relation/articles ############################################
2018-01-02 14:43:51.104664 : # Done: 2018-01-02T13:09:27+0000 (1h 34m 21s ago)
2018-01-02 14:43:51.104684 : process/init/relation/articles/run.sh
2018-01-02 14:43:51.104704 : mark_done process/init/relation/articles
2018-01-02 14:43:51.104853 : ##############################################################################
2018-01-02 14:43:51.104891
2018-01-02 14:43:51.104916
2018-01-02 14:43:51.104941 : ## data/articles #############################################################
2018-01-02 14:43:51.104964 : # Done: 2018-01-02T13:09:27+0000 (1h 34m 21s ago)
2018-01-02 14:43:51.104987 : # no-op
2018-01-02 14:43:51.105006 : mark_done data/articles
2018-01-02 14:43:51.105024 : ##############################################################################
2018-01-02 14:43:51.105041
2018-01-02 14:43:51.105059
2018-01-02 14:43:51.105076 ## process/ext_sentences_by_nlp_markup #######################################
2018-01-02 14:43:51.105093 # Done: 2017-12-30T11:10:56+0000 (3d 3h 32m 52s ago)
2018-01-02 14:43:51.105110 process/ext_sentences_by_nlp_markup/run.sh
2018-01-02 14:43:51.105127 ++ dirname process/ext_sentences_by_nlp_markup/run.sh
2018-01-02 14:43:51.105145 + cd process/ext_sentences_by_nlp_markup
2018-01-02 14:43:51.105162 + export DEEPDIVE_CURRENT_PROCESS_NAME=process/ext_sentences_by_nlp_markup
2018-01-02 14:43:51.105181 + DEEPDIVE_CURRENT_PROCESS_NAME=process/ext_sentences_by_nlp_markup
2018-01-02 14:43:51.105199 + export DEEPDIVE_LOAD_FORMAT=tsv
2018-01-02 14:43:51.105216 + DEEPDIVE_LOAD_FORMAT=tsv
2018-01-02 14:43:51.105233 + deepdive compute execute 'input_sql= SELECT R0.id AS "articles.R0.id", R0.content AS "articles.R0.content"
2018-01-02 14:43:51.105251 FROM articles R0
2018-01-02 14:43:51.105274
2018-01-02 14:43:51.105289 ' 'command="$DEEPDIVE_APP"/udf/nlp_markup.sh' output_relation=sentences
2018-01-02 14:43:51.105311 Executing with the following configuration:
2018-01-02 14:43:51.105329 DEEPDIVE_NUM_PROCESSES=3
2018-01-02 14:43:51.105346 DEEPDIVE_NUM_PARALLEL_UNLOADS=1
2018-01-02 14:43:51.105363 DEEPDIVE_NUM_PARALLEL_LOADS=1
2018-01-02 14:43:51.105380 output_relation_tmp=dd_tmp_sentences
2018-01-02 14:43:51.105397
2018-01-02 14:43:51.374845 CREATE TABLE
2018-01-02 14:43:51.672068 CREATE TABLE
2018-01-02 14:43:51.783679 unloading to feed_processes-1: ' SELECT R0.id AS "articles.R0.id", R0.content AS "articles.R0.content"
2018-01-02 14:43:51.783834 FROM articles R0
2018-01-02 14:43:51.783868
2018-01-02 14:43:51.783890 '
2018-01-02 14:43:51.792792 /home/ubuntu/spouse/udf/nlp_markup.sh: line 22: /home/ubuntu/spouse/udf/bazaar/parser/run.sh: No such file or directory
2018-01-02 14:43:51.793296 /home/ubuntu/spouse/udf/nlp_markup.sh: line 22: /home/ubuntu/spouse/udf/bazaar/parser/run.sh: No such file or directory
2018-01-02 14:43:51.802787 /home/ubuntu/spouse/udf/nlp_markup.sh: line 22: /home/ubuntu/spouse/udf/bazaar/parser/run.sh: No such file or directory
2018-01-02 14:43:51.849967 Loading dd_tmp_sentences from output_computed-1 (tsv format)
unloading: 0:00:00 110 [1.06k/s] ([1.06k/s])
2018-01-02 14:43:51.924416 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 140: kill: (5670) - No such process unloading: 0:00:00 476KiB [ 4.4MiB/s] ([ 4.4MiB/s]) 0 /s])s])r/local/compute-execute: line 140: kill: (5684) - No such process 2018-01-02 14:43:51.934183 [ERROR] command='"$DEEPDIVE_APP"/udf/nlp_markup.sh': PID 5670: finished with non-zero exit status (0) 2018-01-02 14:43:51.934369 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 138: 5671 Terminated DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < process-$i.input > process-$i.output 2018-01-02 14:43:51.934407 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 138: 5672 Terminated DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < process-$i.input > process-$i.output 2018-01-02 14:43:51.934427 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 138: 5676 Terminated mkmimo process-.output > output_computed- 2018-01-02 14:43:51.934445 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 138: 5677 Terminated deepdive-load "$output_relation_tmp" output_computed-* 2018-01-02 14:43:51.935923 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 1: 5683 Terminated deepdive-db unload "$input_sql" "$DEEPDIVE_LOAD_FORMAT" feed_processes-* 2018-01-02 14:43:51.976486 COPY 0 ‘run/ABORTED’ -> ‘20180102/144348.236896357’
can you check if home/ubuntu/spouse/udf/nlp_markup.sh exists? if it does not, copy it from the examples/spouse/udf folder to yours
