Mathijs de Bruin
Mathijs de Bruin
Leaving the caller to decide how to deal with it and separating initialisation from listening.
Adding Date and Provider data, and potentially SpanContext. In the process, Provider channel (in sniffer) should be pointer stream, preventing copying of data. This includes getting the first/last seen date...
Need to specify what to do on errors; it currently just records any filter errors and excludes those items.
https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-multi-get.html Should increase Get performance. Implies adding MultiGet to index interface and then adding an implementation to elasticsearch. Ref: https://github.com/ipfs-search/ipfs-search/blob/master/index/multiget.go
Should already be known the moment we're scraping - but might be some extra load for updates. Though we'd have to manually call `dht/findproviders` (or something similar) - it's not...
This is an issue that stems from go-ipfs through go-ipfs-api.
Index IPNS entries. I guess the sensible way would be to create an IPNS index with the IPNS id (pubkey) as ES document id. The document structure could be: ```json...
Allows running this on servers without triggering netscan detection. For now, this is on by default. Might not want to merge-as is, unless the default application for this is on...
**Describe the bug** When a website links to assets over IPFS using gateway URL's, they are loaded over the gateway rather than redirected to a configured gateway (e.g. local node)....