scrapix
scrapix copied to clipboard
meilisearch
**Windows 10 22H2**, **Node 18** Running my own config or sample ones always causes this issue: ``` yarn start -p simple.json Sender::constructor Sender::init Webhook::constructor Webhook not configured; if you want...
I've been testing out scrapix and first off, awesome work! With a little bit of tinkering around I got it working with meilisearch cloud FAST! That said, it could be...
Scrapix docker image only accepts a JSON string to pass the configuration. The problem arises when trying to pass a documentTemplate, which uses Liquid syntax: the JSON string should not...
### Steps to reproduce 1. Run the latest meilisearch image from docker. 2. Place a reverse proxy, says Caddy, before the meilisearch container with the configuration: ``` :7701 { reverse_proxy...
Currently, we can exclude URLs but not CSS selectors in a particular page. For instance, in Meilisearch documentation there is a section to give feedback, which doesn't make sense to...
The README states the following: ``` hierarchy_lvl1: the h1 of the block hierarchy_lvl2: the h2 of the block hierarchy_lvl3: the h3 of the block hierarchy_lvl4: the h4 of the block...
Today, when any error happens in the crawler the listener (webhook) is not being triggered. This should be fixed, and the failed handler should be implemented in the listener as...
This simple contribution uses the environment variable to get the npm package version instead of updating manually the version on a file. Not sure if it's working on Docker but...
Implement a WebSocket that would allow following the process of a crawling request.
## Context Some websites have multiple URL's pointing to the same page. For example in openai: - https://platform.openai.com/docs/plugins/getting-started - https://platform.openai.com/docs/plugins/getting-started/plugin-manifest - https://platform.openai.com/docs/plugins/getting-started/running-a-plugin ## Problem Since the crawler is not able...
