gitonthescene
gitonthescene
FWIW, my vision is that you could spin up scalable reconciliation services with some cloud service and keep them up as long as necessary. So for large jobs you'd want...
That sounds reasonable to me. Services could add such handling by using a proxy as mentioned in #40 and don't necessarily need to hand implement it directly into the service....
Tangentially related, I just learned of [this tool](https://github.com/rakyll/hey) for testing server load handling.
@mixterj - The suggestion at the start of this issue is to put the allowed max size of the batch in the manifest. This doesn’t directly address concurrency but if...
If the client limits the number of requests it sends or the size of the batches it sends there is little the service can do to improve performance. If you...
Of course people can set up alternative workflows which perform reconciliation through their own clients, side-stepping the limitations in OpenRefine but somehow encouraging that doesn’t seem to be in anyone’s...
Hello, I've been playing with the [Wikidata SPARQL](https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/Wikidata_Query_Help) interface quite a bit lately. The data there isn't nearly as complete as the data on Wikipedia (presumably because someone needs to...
Similarly, [this query](https://query.wikidata.org/#SELECT%20DISTINCT%20%3FterritoryLabel%20WHERE%20%7B%0A%20%20%20%20%7B%0A%20%20%20%20%20%20%3Fterritory%20wdt%3AP31%20wd%3AQ1322134%3B%0A%20%20%20%20%20%20p%3AP2046%2Fpsn%3AP2046%2Fwikibase%3AquantityAmount%20%3Farea.%0A%20%20%20%20%20%20FILTER%20%28%3Farea%20%3E%202000%29%0A%20%20%20%20%7D%0A%20%20%20%20SERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%0A%20%20%7D%0A) makes an argument for including the Gulf of Maine and the Gulf of Saint Lawrence.
It's interesting to note that none of the states in [this query](https://query.wikidata.org/#SELECT%20DISTINCT%20%3Fterritory%20%3FterritoryLabel%20%3Fpopulation%20WHERE%20%7B%0A%20%20%7B%0A%20%20%20%20%3Fterritory%20wdt%3AP31%20wd%3AQ15634554%3B%0A%20%20%20%20%20%20wdt%3AP1082%20%3Fpopulation.%0A%20%20%7D%0A%20%20SERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%0A%20%20FILTER%28NOT%20EXISTS%20%7B%20%3Fterritory%20%28wdt%3AP31%2F%28wdt%3AP279%2B%29%29%20wd%3AQ15893266.%20%7D%29%0A%20%20FILTER%28NOT%20EXISTS%20%7B%20%3Fterritory%20%28wdt%3AP576%7Cwdt%3AP582%29%20%3Fend.%20%7D%29%0A%20%20FILTER%28%20EXISTS%20%7B%20%3Fterritory%20wdt%3AP31%20wd%3AQ23037160.%20%7D%29%0A%0A%7D) are tagged as `sovereign state`, but instead are tagged as `state with limited recognition`. That designation pulls in...
Agreed. I think it would be tough to consider the queries anything more than a tool given that the data can be sketchy. I.e. I wouldn't declare anything coming from...