datagov-wptheme
datagov-wptheme copied to clipboard
default to Daily harvests for all harvest sources unless requested otherwise by non-federal sources
To be the best resource for open data, Data.gov should be as up-to-date as possible.
Currently many non-federal harvest sources are set to weekly, bi-weekly, or monthly harvests: https://catalog.data.gov/harvest?frequency=WEEKLY, https://catalog.data.gov/harvest?frequency=BIWEEKLY, or https://catalog.data.gov/harvest?frequency=MONTHLY
Many city and state open data portals update daily and Data.gov should reflect that unless requested otherwise. Local government should be directed to request that on this form https://www.data.gov/local/add and/or via the onboarding process.
@rebeccawilliams do you know how I can get the re-harvesting settings adjusted for the endpoint that I manage? I think right now that data.gov is never re-harvesting it, but I would like to set it to weekly or monthly.
@d3netxer cc-ing @philipashlock here, but also email [email protected] for help questions, you should get a quick response; adjusting harvesting settings doesn't take that long on Data.gov's side!