bigmetadata icon indicating copy to clipboard operation
bigmetadata copied to clipboard

Casing issue with tables

Open juanignaciosl opened this issue 6 years ago • 0 comments

SimplifiedDownloadTiger_zcta5_2015 fails to me with this error:

2018-09-18 19:19:49,462 [INFO]: [pid 1] Worker Worker(salt=399891488, workers=1, host=3ca5514aad8b, username=root, pid=1) running   tasks.us.census.tiger.SimplifiedDownloadTiger(year=2015, geography=zcta5)
2018-09-18 19:19:50,397 [ERROR]: [pid 1] Worker Worker(salt=399891488, workers=1, host=3ca5514aad8b, username=root, pid=1) failed    tasks.us.census.tiger.SimplifiedDownloadTiger(year=2015, geography=zcta5)
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1184, in _execute_context
    context)
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/default.py", line 462, in do_execute
    cursor.execute(statement, parameters)
psycopg2.ProgrammingError: relation "us.census.tiger.DownloadTiger_2015_8bcc49cd24" does not exist
LINE 1: SELECT row_number() over () FROM "us.census.tiger"."Download...
                                         ^


The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/luigi/worker.py", line 184, in run
    missing = [dep.task_id for dep in self.task.deps() if not dep.complete()]
  File "/usr/local/lib/python3.5/dist-packages/luigi/worker.py", line 184, in <listcomp>
    missing = [dep.task_id for dep in self.task.deps() if not dep.complete()]
  File "/usr/local/lib/python3.5/dist-packages/luigi/task.py", line 553, in complete
    return all(map(lambda output: output.exists(), outputs))
  File "/usr/local/lib/python3.5/dist-packages/luigi/task.py", line 553, in <lambda>
    return all(map(lambda output: output.exists(), outputs))
  File "/bigmetadata/tasks/targets.py", line 79, in exists
    return self._existenceness() == 2
  File "/bigmetadata/tasks/targets.py", line 62, in _existenceness
    schema=self._schema, tablename=self._tablename, where=self._where))
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line 1044, in execute
    bind, close_with_result=True).execute(clause, params or {})
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 947, in execute
    return meth(self, multiparams, params)
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/sql/elements.py", line 262, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1055, in _execute_clauseelement
    compiled_sql, distilled_params
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1191, in _execute_context
    context)
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1386, in _handle_dbapi_exception
    exc_info
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/util/compat.py", line 202, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/util/compat.py", line 185, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1184, in _execute_context
    context)
  File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/default.py", line 462, in do_execute
    cursor.execute(statement, parameters)
sqlalchemy.exc.ProgrammingError: (psycopg2.ProgrammingError) relation "us.census.tiger.DownloadTiger_2015_8bcc49cd24" does not exist
LINE 1: SELECT row_number() over () FROM "us.census.tiger"."Download...
                                         ^
 [SQL: 'SELECT row_number() over () FROM "us.census.tiger"."DownloadTiger_2015_8bcc49cd24" WHERE 1 = 1 LIMIT 1']
2018-09-18 19:19:50,458 [INFO]: Informed scheduler that task   tasks.us.census.tiger.SimplifiedDownloadTiger_zcta5_2015_002ffff4ff   has status   FAILED

cc @antoniocarlon

juanignaciosl avatar Sep 19 '18 08:09 juanignaciosl