ipfs-search
ipfs-search copied to clipboard
Search engine for the Interplanetary Filesystem.
Leaving the caller to decide how to deal with it and separating initialisation from listening.
Adding Date and Provider data, and potentially SpanContext. In the process, Provider channel (in sniffer) should be pointer stream, preventing copying of data. This includes getting the first/last seen date...
Need to specify what to do on errors; it currently just records any filter errors and excludes those items.
https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-multi-get.html Should increase Get performance. Implies adding MultiGet to index interface and then adding an implementation to elasticsearch. Ref: https://github.com/ipfs-search/ipfs-search/blob/master/index/multiget.go
Hi IPFS Search folks! I'm very interested to learn what is the average lifetime of a file on the IPFS network, from the moment it starts being provider to the...
Should already be known the moment we're scraping - but might be some extra load for updates. Though we'd have to manually call `dht/findproviders` (or something similar) - it's not...
This is an issue that stems from go-ipfs through go-ipfs-api.
Index IPNS entries. I guess the sensible way would be to create an IPNS index with the IPNS id (pubkey) as ES document id. The document structure could be: ```json...
Configure timeouts for bulk writes, allowing larger chunks to be written less frequently.