li icon indicating copy to clipboard operation
li copied to clipboard

Cache-only scraper

Open shaperilio opened this issue 4 years ago • 0 comments

Description

Develop a scraper that can ingest a source list and do nothing with it other than cache.

Why do you need this feature or component?

This would allow non-technical volunteers to vet and contribute sources from around the world so that we can start caching them. Many sources don't have time series data so it's a "race against time" if we want to eventually have temporal data for everything.

Additional context

As per @chunder's suggestion, I started a spreadsheet (WIP) that this scraper would draw from.

shaperilio avatar Apr 05 '20 17:04 shaperilio