data-stories-scripts icon indicating copy to clipboard operation
data-stories-scripts copied to clipboard

Data Story: California State Parks Data

Open feep opened this issue 4 years ago • 5 comments

Three stories:

Generate and use dataset

  • [x] Generate csv from https://www.parks.ca.gov/ParkIndex
  • [x] Generate sample file, .kmx location file to be used with gps software

Improve dataset

  • [x] meta.json
  • [x] transform.star to do what the python script did in the first story

Validate with schema.json

  • [ ] structure.json

feep avatar Mar 30 '20 21:03 feep

Blockers

2.

  • [x] Invalid escape https://github.com/qri-io/qri/issues/1314

3.

feep avatar Apr 02 '20 11:04 feep

We can cut the validation bit, and I can publish the dataset to a new user if you want the story to go asap.

feep avatar Apr 02 '20 19:04 feep

structure.json bit deferred to a separate story, so we can post this.

Especially since @Arqu is working on jsonschema.

https://github.com/qri-io/jsonschema/pull/63 and future PRs.

feep avatar Apr 22 '20 21:04 feep

Oh, just to add to this, think you should definitely proceed with this and "unblock" yourself for the time being by doing what Holger did and you can refer to this for a bit more input.

In a nutshell, for the problematic onces you should do an anyOf with your current validation rules + type [string, null] to account for the None/Null values. A bit of fiddling should get you to a spot that works. It's not pretty, but should get you over the hump. The jsonschema work will take a while to land, especially the part with nullables.

Arqu avatar Apr 22 '20 21:04 Arqu

Right, I got the working JSON from Holger.

=]

Thanks, Holger.

Anyway still deferring structure.json for other reasons.

Will write later. Maybe with new "AllowNullable" Maybe without.

feep avatar Apr 22 '20 21:04 feep