Dataset Request: US GOV Datasets

[rmax]

URL: http://catalog.data.gov/dataset

[rmax]

This is a huge one, though. At this point I wonder if it may be better to use a micro-service for the search rather than local indexing and search capabilities. Although APT uses xapian for local search, we opted for whoosh as it's a pure python search engine.

[rmax]

We could follow brew tap approach and move these big datasets aggregators to its own recipes repository, and the users may choose to use it. A drawback is that the initial db won't be as comprehensive as it could be.