Gene Leynes

Results 59 comments of Gene Leynes

The bigger issue is that you need to download the data in increments of 50k rows, so you can't just use one command to (reliably) download everything one url. The...

Also note those download times are _after_ the first download, so the data was cached on Socrata.

I don't understand exactly why we're testing the number of columns for #118. In fact, I don't understand what was special about these data sets was causing what error. I...

Here's one example for food inspections. ``` CSV query: https://data.cityofchicago.org/resource/4ijn-s7e5.csv?$where=inspection_date>'2018-12-31T00:00:00 CSV columns: [1] "Inspection.ID" "DBA.Name" "AKA.Name" "License.." "Facility.Type" [6] "Risk" "Address" "City" "State" "Zip" [11] "Inspection.Date" "Inspection.Type" "Results" "Violations" "Latitude"...

Actually this is a duplicate of #32, although this is better worded / documented. I would prefer to keep this one open because it is more active.

I happened to open an issue about this (with Socrata) earlier this week in the course of doing other work. Socrata does not support column ordering in the JSON response,...

I think we should use syntax similar to [hurl.it](https://www.hurl.it/?method=GET&url=https%3A%2F%2Fsoda.demo.socrata.com%2Fresource%2F4tka-6guv&headers=%7B%22X-App-Token%22%3A[%22bjp8KrRvAPtuf809u1UXnI0Z8%22]%7D&args=%7B%22%24order%22%3A[%22magnitude+DESC%22]%2C%22%24limit%22%3A[%2210%22]%7D)

I just had to work around this exact issue again, so it's fresh in my mind. I agree with @dmpe on all points, and would add a little more. ####...

I found a situation where you would not get all the columns in JSON that you would in CSV (if you skipped the "nested" fields as I was proposing). https://data.edmonton.ca/resource/sy89-z97q...

This works, and can be used to check the expected output: `jsonlite::fromJSON(readLines(q))`