docsearch-scraper icon indicating copy to clipboard operation
docsearch-scraper copied to clipboard

Add check for "unknown" parameters in DocSearch config

Open JanPetr opened this issue 8 years ago • 1 comments

I had a min_indexed_lvl parameter in a config, but the parameter is actually called min_indexed_level. But DocSearch scraper crawled the site as usual and I had no idea there is something wrong.

Is it possible to add a check which would raise a warning message when there are “unknown” parameters in the config?

JanPetr avatar Jan 18 '17 22:01 JanPetr

Yeah you are right, I had the same issue :/

We have some validations: https://github.com/algolia/docsearch-scraper/blob/master/scraper/src/config/config_validator.py

It should be pretty easy to had more validations.

ElPicador avatar Jan 19 '17 09:01 ElPicador