bigmetadata
bigmetadata copied to clipboard
Casing issue with tables
SimplifiedDownloadTiger_zcta5_2015
fails to me with this error:
2018-09-18 19:19:49,462 [INFO]: [pid 1] Worker Worker(salt=399891488, workers=1, host=3ca5514aad8b, username=root, pid=1) running tasks.us.census.tiger.SimplifiedDownloadTiger(year=2015, geography=zcta5)
2018-09-18 19:19:50,397 [ERROR]: [pid 1] Worker Worker(salt=399891488, workers=1, host=3ca5514aad8b, username=root, pid=1) failed tasks.us.census.tiger.SimplifiedDownloadTiger(year=2015, geography=zcta5)
Traceback (most recent call last):
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1184, in _execute_context
context)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/default.py", line 462, in do_execute
cursor.execute(statement, parameters)
psycopg2.ProgrammingError: relation "us.census.tiger.DownloadTiger_2015_8bcc49cd24" does not exist
LINE 1: SELECT row_number() over () FROM "us.census.tiger"."Download...
^
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.5/dist-packages/luigi/worker.py", line 184, in run
missing = [dep.task_id for dep in self.task.deps() if not dep.complete()]
File "/usr/local/lib/python3.5/dist-packages/luigi/worker.py", line 184, in <listcomp>
missing = [dep.task_id for dep in self.task.deps() if not dep.complete()]
File "/usr/local/lib/python3.5/dist-packages/luigi/task.py", line 553, in complete
return all(map(lambda output: output.exists(), outputs))
File "/usr/local/lib/python3.5/dist-packages/luigi/task.py", line 553, in <lambda>
return all(map(lambda output: output.exists(), outputs))
File "/bigmetadata/tasks/targets.py", line 79, in exists
return self._existenceness() == 2
File "/bigmetadata/tasks/targets.py", line 62, in _existenceness
schema=self._schema, tablename=self._tablename, where=self._where))
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line 1044, in execute
bind, close_with_result=True).execute(clause, params or {})
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 947, in execute
return meth(self, multiparams, params)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/sql/elements.py", line 262, in _execute_on_connection
return connection._execute_clauseelement(self, multiparams, params)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1055, in _execute_clauseelement
compiled_sql, distilled_params
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1191, in _execute_context
context)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1386, in _handle_dbapi_exception
exc_info
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/util/compat.py", line 202, in raise_from_cause
reraise(type(exception), exception, tb=exc_tb, cause=cause)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/util/compat.py", line 185, in reraise
raise value.with_traceback(tb)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1184, in _execute_context
context)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/default.py", line 462, in do_execute
cursor.execute(statement, parameters)
sqlalchemy.exc.ProgrammingError: (psycopg2.ProgrammingError) relation "us.census.tiger.DownloadTiger_2015_8bcc49cd24" does not exist
LINE 1: SELECT row_number() over () FROM "us.census.tiger"."Download...
^
[SQL: 'SELECT row_number() over () FROM "us.census.tiger"."DownloadTiger_2015_8bcc49cd24" WHERE 1 = 1 LIMIT 1']
2018-09-18 19:19:50,458 [INFO]: Informed scheduler that task tasks.us.census.tiger.SimplifiedDownloadTiger_zcta5_2015_002ffff4ff has status FAILED
cc @antoniocarlon