Julien Nioche

I am trying to index documents using the Vespa HTTP client. One thing I need to do is to create some of these documents only if they don't already exist....

Detect incorrect makernote offsets

6

[FEATURE REQUEST] Copied from [https://stackoverflow.com/q/56445656/432844](https://stackoverflow.com/q/56445656/432844) EXIFTool can detect when the offset of tags is incorrect [ExifTool] Warning : [minor] Possibly incorrect maker notes offsets (fix by 1060?) Can we detect...

Integrate URLFrontier as a backend for URL storage?

1

Hi, This is a question, not a bug report. [url-frontier](https://github.com/crawler-commons/url-frontier) is an API to define a [crawl frontier](https://en.wikipedia.org/wiki/Crawl_frontier). It uses gRPC and has a service implementation. It is crawler-neutral and...

Integrate URLFrontier as a backend for URL storage

4

Hi, This is a question, not a bug report. [url-frontier](https://github.com/crawler-commons/url-frontier) is an API to define a [crawl frontier](https://en.wikipedia.org/wiki/Crawl_frontier). It uses gRPC and has a service implementation. It is crawler-neutral and...

Delete redirected pages

1

From a user `Links that were once pages and then turn to redirects are our issue. Our content management system auto creates clean URLs. If the title of the page...

``` 022-07-15 09:57:16.851 o.a.s.e.e.ReportError Thread-43-fetcher-executor[15, 15] [ERROR] Error java.lang.RuntimeException: java.lang.RuntimeException: java.util.ConcurrentModificationException at org.apache.storm.utils.Utils$1.run(Utils.java:411) ~[storm-client-2.4.0.jar:2.4.0] at java.lang.Thread.run(Thread.java:829) [?:?] Caused by: java.lang.RuntimeException: java.util.ConcurrentModificationException at org.apache.storm.executor.Executor.accept(Executor.java:301) ~[storm-client-2.4.0.jar:2.4.0] at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113) ~[storm-client-2.4.0.jar:2.4.0] at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89) ~[storm-client-2.4.0.jar:2.4.0]...

asynchronous queries and updates in SOLR?

1

Maybe https://github.com/inoio/solrs would be useful?

Add support for shards in SOLR

3

Just like it's done in ES, we could route the documents in the statusupdaterbolt based on the host / name or IP and in the spouts check that the number...

https://www.elastic.co/blog/aggregate-data-faster-with-new-the-random-sampler-aggregation