django-calaccess-raw-data

django-calaccess-raw-data copied to clipboard

Bumps [django](https://github.com/django/django) from 3.2.13 to 3.2.14. Commits 746e88c [3.2.x] Bumped version for 3.2.14 release. a9010fe [3.2.x] Fixed CVE-2022-34265 -- Protected Trunc(kind)/Extract(lookup_name) ag... 3acf156 [3.2.x] Fixed GEOSTest.test_emptyCollections() on GEOS 3.8.0. 4a5d98e...

dependabot[bot]

palewire

Idea for correcting data

2

I have been examining some of the errors in the data. Since the SoS publishes the data and only adds to it, and will never correct any line of data...

rkiddy

Also, "S.M." is too long for max_length = 3

breardon2011

``` Loading CvrF470Cd Traceback (most recent call last): File "manage.py", line 9, in execute_from_command_line(sys.argv) File "/home/palewire/.virtualenvs/django-calaccess-processed-data/local/lib/python3.5/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line utility.execute() File "/home/palewire/.virtualenvs/django-calaccess-processed-data/local/lib/python3.5/site-packages/django/core/management/__init__.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/home/palewire/.virtualenvs/django-calaccess-processed-data/local/lib/python3.5/site-packages/django/core/management/base.py",...

palewire

Refactor cleancalaccessrawfile to use lower-level command-line tools or other methods that are faster than the current slow Python loop through each file

3

palewire

``` $ python manage.py updatecalaccessrawdata /home/ben/.virtualenvs/django-calaccess-downloads-website/local/lib/python2.7/site-packages/django/db/models/fields/__init__.py:1430: RuntimeWarning: DateTimeField RawDataVersion.release_datetime received a naive datetime (2016-07-27 00:00:00) while time zone support is active. RuntimeWarning) ```

palewire

This option was added to several of our custom management commands back when we were developing the initial etl process. Reaching back in my memory...I think the idea was to...

gordonje

Log of instances where CAL-ACCESS zip_file download fails

24

Today was the first time we noticed issues accessing the CAL-ACCESS zip file, which has typically been updated at http://campaignfinance.cdn.sos.ca.gov/dbwebexport.zip every day. I've been trying it all day and have...

gordonje

Expand dat support

3

This is a general ticket for integrating our data pipeline into [maxogden/dat](https://github.com/maxogden/dat). See #282 and #281 for other dat related tickets.

aboutaaron