scraper icon indicating copy to clipboard operation
scraper copied to clipboard

Merge multiple sources of information

Open vretro opened this issue 7 years ago • 1 comments

Thank you for your continued efforts with scraper

I have a feature request I'd like to run past you.

I've found many sources of data available in scraper provide inaccurate player counts. Is it possible to have an option to always append a higher player count if a higher value is returned?

This way inaccurate values will more likely be replaced with accurate values. Also values which are already correct, are less likely to be replaced with smaller inaccurate values.

Thanks

vretro avatar Jul 14 '17 19:07 vretro

This is an interesting idea. It could easily be extended to other properties. Players is an odd property. When I first saw it, I made it an integer and then had it soon fail when values were 1-2, 4+, and other odd values. If I assumed 1 was somewhat of a default and anything else was probably correct it could work. This would be slower since I would have to make 1 query per data source then merge vs today where I query each in series and stop once one returns a real value.

I won't make any promises but will think about it.

sselph avatar Jul 15 '17 05:07 sselph