Create data.json for each cached portal

[jqnatividad]

see https://project-open-data.cio.gov/catalog/

One way this could be done is by fetching the existing data.json on the Socrata portal (e.g. https://nycopendata.socrata.com/data.json) and then transforming the URLs to their opendatacache equiv thru some regex, and then mounting the data.json on opendata.cache, e.g. http://www.opendatacache.com/data.cityofnewyork.us/data.json

[talos]

I'm not clear what you're suggesting. If it's caching the existing Socrata data.json file at the suggested URL, that's just a matter of slightly updating the proxy setup in nginx.

If it's a transformation of Socrata's data.json, I'm curious what that transformation is, and what the value add is.

[jqnatividad]

It's the latter - a transform of the data.json with the opendatacache url instead of the socrata url.

In this way, if I want to harvest the data and use data.json, its pretty straightforward and it doubles as the lightweight "API"/manifest of the opendatacached site.

[talos]

OK -- I get it. You're talking about an opendatacache data.json for each mirrored portal, with links to opendatacache URLs for each entry instead of the original socrata url?