Mathijs de Bruin

Results 134 issues of Mathijs de Bruin

Allows us to have named workers, cleans up code, etc.

feature

Example: https://gateway.ipfs.io/ipfs/bafybeihoqfxb3jvqxviom4mqmu3ntabqdfqse7f5u26z32qxifjhksknyi/094-gossipsub-v1.1-headerimage+grid.jpeg results in https://gateway.ipfs.io/ipfs/bafybeihoqfxb3jvqxviom4mqmu3ntabqdfqse7f5u26z32qxifjhksknyi/094-gossipsub-v1.1-headerimage%20grid.jpeg being requested through ipfs-tika, resulting in 404.

bug

Like such: https://github.com/licenses/license-templates/blob/master/templates/agpl3-header.txt Suggestion to use: https://github.com/cloudposse/copyright-header

There are CIDv0 hashes which are, in fact, the same as CIDv1 hashes and we are currently indexing both. We could normalise the existing index to work with CIDv1 only,...

feature

We should keep logs *infinite* but then also mask IP's properly. https://www.nginx.com/blog/data-masking-user-privacy-nginscript/

feature

Allowing users to tag content and/or mark content as interesting (like).

feature

RabbitMQ is taking 10-15% of server CPU, is complicated to configure and implement and it doesn't scale well. NSQ seems to have much better properties for this particular application, as...

feature

Depends on: https://github.com/arewedistributedyet/arewedistributedyet/issues/28 Ref: https://docs.ipfs.io/how-to/address-ipfs-on-web/#further-resources

feature
blocked

1. Detect IPFS links in extracted URLs 2. Queue indexing for it. Example: ```go for raw_url := range metadata.urls { url, err := URL.Parse(raw_url) if err != nil { return...

TODO

Similar but not identical to invalids, as to avoid repeated crawling, unless they are referred to.

TODO