Maxwell Austensen
Maxwell Austensen
As @aepyornis [suggested](https://github.com/nycdb/nycdb/pull/143#issuecomment-715342860) in #143, rather than having sql utility functions (eg. [first() and last()](https://github.com/nycdb/nycdb/blob/main/src/nycdb/sql/hpd_registrations/first_last.sql))stored with each dataset that uses them, we should reorganize them all into a separate folder...
@toolness suggested that we should have a [changelog](https://keepachangelog.com/en/1.0.0/) that documents what's been changed in each release, and to use [semantic versioning](https://semver.org/) (which I think we already are?), so I've attempted...
It doesn't seem like there's an easy way to identify buildings that are owner-occupied, and the NYS STAR tax benefit could help with that. The benefit shows up in Statement...
@sraby noticed that [taxbills.nyc](http://taxbills.nyc/) is down. We should reach out to John and see if he just doesn't want to host it anymore and maybe we can offer to take...
BIN does not have a consistent datatype across the various datasets. I think we should change them all to `char(7)` the way that we have for BBL as `char(10)`.
As noted [here](https://github.com/nycdb/nycdb/pull/129#issuecomment-625322860), nycdb's current method of [parsing arrays](https://github.com/nycdb/nycdb/blob/master/src/nycdb/typecast.py#L139-L140) doesn't support the format for arrays in csv files exported by posgres, which includes curly braces etc.
As I was creating the documentation entries for these datasets I noticed that the `oath_hearings` and `ecb_violations` tables [can be linked](https://github.com/nycdb/nycdb/wiki/Dataset:-ECB-Violations#get-information-about-oath-hearings-associated-with-a-violation) using a common field, but it is formatted differently...
This PR finishes up the project of adding OCA (office of court administration) eviction filings data to WOW. First the backend work was done in #642 to extract the necessary...
This PR adds a new field to the table schemas (yaml) for shapefiles to specify the SRID (projection) of the source data, and then uses the `shp2pgsql` option to transform...
``` InvalidTextRepresentation: invalid input syntax for type boolean: "" LINE 1: ...L,NULL,'',NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,'','',NULL... ^ error_handling(/app/load_dataset.py:375) yield main(/app/load_dataset.py:406) load_dataset(dataset) load_dataset(/app/load_dataset.py:344) ds.db_import() db_import(/usr/local/lib/python3.9/site-packages/nycdb/dataset.py:73) self.import_schema(schema) import_schema(/usr/local/lib/python3.9/site-packages/nycdb/dataset.py:124) self.db.insert_rows(batch, table_name=schema['table_name']) insert_rows(/usr/local/lib/python3.9/site-packages/nycdb/database.py:45) curs.execute(sql.insert_many(curs, table_name, rows)) execute(/usr/local/lib/python3.9/site-packages/psycopg/cursor.py:737) raise...