data-stories-scripts
data-stories-scripts copied to clipboard
Data Story: California State Parks Data
Three stories:
Generate and use dataset
- [x] Generate csv from https://www.parks.ca.gov/ParkIndex
- [x] Generate sample file,
.kmx
location file to be used with gps software
Improve dataset
- [x]
meta.json
- [x]
transform.star
to do what the python script did in the first story
Validate with schema.json
- [ ]
structure.json
Blockers
2.
- [x] Invalid escape https://github.com/qri-io/qri/issues/1314
3.
- [x] Can’t figure out how to allow
None
instructure.json
- [ ] Allow
None
fromtransform.star
- [ ] Segfault https://github.com/qri-io/qri/issues/1207
- [x] Totally broken qri, can’t use desktop or checkout the correct dataset
We can cut the validation bit, and I can publish
the dataset to a new user if you want the story to go asap.
structure.json
bit deferred to a separate story, so we can post this.
Especially since @Arqu is working on jsonschema.
https://github.com/qri-io/jsonschema/pull/63 and future PRs.
Oh, just to add to this, think you should definitely proceed with this and "unblock" yourself for the time being by doing what Holger did and you can refer to this for a bit more input.
In a nutshell, for the problematic onces you should do an anyOf
with your current validation rules + type [string, null]
to account for the None/Null values. A bit of fiddling should get you to a spot that works. It's not pretty, but should get you over the hump. The jsonschema work will take a while to land, especially the part with nullables.
Right, I got the working JSON from Holger.
=]
Thanks, Holger.
Anyway still deferring structure.json
for other reasons.
Will write later. Maybe with new "AllowNullable" Maybe without.