govtrack.us-web icon indicating copy to clipboard operation
govtrack.us-web copied to clipboard

django.db.utils.OperationalError: too many SQL variables

Open GPHemsley opened this issue 11 years ago • 1 comments

When parsing votes:

[…]
root: Processed 1020 files [99%]
Missing amendment data/us/113/rolls/s2013-237.xml
Missing amendment data/us/113/rolls/s2013-155.xml
Traceback (most recent call last):
  File "./parse.py", line 111, in <module>
    main()
  File "./parse.py", line 81, in main
    main2()
  File "./parse.py", line 104, in f
    return func(*args,**kwargs)
  File "./parse.py", line 77, in main2
    getattr(parser, kwargs.method)(kwargs)
  File "/home/gphemsley/Development/Government/GitHub/govtrack/govtrack.us-web/parser/vote_parser.py", line 309, in main
    log_delete_qs(Vote.objects.filter(congress=options.congress).exclude(id__in = seen_obj_ids))
  File "/home/gphemsley/Development/Government/GitHub/govtrack/govtrack.us-web/parser/vote_parser.py", line 139, in log_delete_qs
    if qs.count() > 0:
  File "/home/gphemsley/Development/Government/GitHub/govtrack/govtrack.us-web/.env/local/lib/python2.7/site-packages/django/db/models/query.py", line 291, in count
    return self.query.get_count(using=self.db)
  File "/home/gphemsley/Development/Government/GitHub/govtrack/govtrack.us-web/.env/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 390, in get_count
    number = obj.get_aggregation(using=using)[None]
  File "/home/gphemsley/Development/Government/GitHub/govtrack/govtrack.us-web/.env/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 356, in get_aggregation
    result = query.get_compiler(using).execute_sql(SINGLE)
  File "/home/gphemsley/Development/Government/GitHub/govtrack/govtrack.us-web/.env/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 781, in execute_sql
    cursor.execute(sql, params)
  File "/home/gphemsley/Development/Government/GitHub/govtrack/govtrack.us-web/.env/local/lib/python2.7/site-packages/django/db/backends/util.py", line 53, in execute
    return self.cursor.execute(sql, params)
  File "/home/gphemsley/Development/Government/GitHub/govtrack/govtrack.us-web/.env/local/lib/python2.7/site-packages/django/db/utils.py", line 99, in __exit__
    six.reraise(dj_exc_type, dj_exc_value, traceback)
  File "/home/gphemsley/Development/Government/GitHub/govtrack/govtrack.us-web/.env/local/lib/python2.7/site-packages/django/db/backends/util.py", line 53, in execute
    return self.cursor.execute(sql, params)
  File "/home/gphemsley/Development/Government/GitHub/govtrack/govtrack.us-web/.env/local/lib/python2.7/site-packages/django/db/backends/sqlite3/base.py", line 450, in execute
    return Database.Cursor.execute(self, query, params)
django.db.utils.OperationalError: too many SQL variables

GPHemsley avatar Feb 25 '14 04:02 GPHemsley

If it got that far it worked OK. Maybe I can just disable that part for SQLite. It's checking if any bills in the database don't correspond to files on disk.

JoshData avatar Feb 25 '14 13:02 JoshData