Marek Kadek
Marek Kadek
Due to licensing changes in ES, the OpenDistroForElastic will fork last viable ES (7.10) , and since 7.11 is already out they will probably start diverging soon. I don't suppose...
There is what I believe same inference problem as in #6 with subscribe method, which is very unfortunace... Can we do do something about it ?
- [ ] how to install it - [ ] how to create simple crawler - [ ] how to store result in file / json - [ ] how...
That would also be able to affect browser inbetween calls. #33 shows the issue clearly.
#26 gave rise to some spurious proxy tests. It would be better to handle them better.
I.e. for fetching `http://creativecommons.org/licenses/by-sa/3.0/` you may get forbidden. There should be way to handle what we wish to do. This probably relates to #19
Publish code coverage with each commit (and on PRs)
- [ ] ability to telnet into running crawler - [ ] ability to observe what's currently happening with crawler - [ ] ability to kill/cancel/control(?) crawler
Request may (and will fail) on unrelated errors. There should be configurable mechanism for retrying.
At least for core stuff...