datagov-wptheme icon indicating copy to clipboard operation
datagov-wptheme copied to clipboard

default to Daily harvests for all harvest sources unless requested otherwise by non-federal sources

Open rebeccawilliams opened this issue 8 years ago • 2 comments

To be the best resource for open data, Data.gov should be as up-to-date as possible.

Currently many non-federal harvest sources are set to weekly, bi-weekly, or monthly harvests: https://catalog.data.gov/harvest?frequency=WEEKLY, https://catalog.data.gov/harvest?frequency=BIWEEKLY, or https://catalog.data.gov/harvest?frequency=MONTHLY

Many city and state open data portals update daily and Data.gov should reflect that unless requested otherwise. Local government should be directed to request that on this form https://www.data.gov/local/add and/or via the onboarding process.

rebeccawilliams avatar Nov 08 '16 19:11 rebeccawilliams

@rebeccawilliams do you know how I can get the re-harvesting settings adjusted for the endpoint that I manage? I think right now that data.gov is never re-harvesting it, but I would like to set it to weekly or monthly.

d3netxer avatar Apr 25 '17 17:04 d3netxer

@d3netxer cc-ing @philipashlock here, but also email [email protected] for help questions, you should get a quick response; adjusting harvesting settings doesn't take that long on Data.gov's side!

rebeccawilliams avatar Apr 25 '17 18:04 rebeccawilliams