docs-scraper icon indicating copy to clipboard operation
docs-scraper copied to clipboard

the command docs_scraper could not be found within PATH or Pipfile's [scripts].

Open silvia-YQY opened this issue 3 years ago • 1 comments

hi I have trouble in using the docker scraper, I try it on mac, when I run the docker, it tell me the command docs_scraper could not be found within PATH or Pipfile's [scripts].. I don't know what I did wrong. Can you help me solve this problem?

#My steps

frist

docker run -d  -it --rm -e MEILI_MASTER_KEY=trantor   -p 9494:9494    -v $(pwd)/data.ms:/data.ms  meilisearch_chrome

  • meilisearch_chrome is my local image which in order to solve the Env CHROMEDRIVER_PATH='/usr/bin/chromedriver' is not a path to a file problem

second

docker run -t --rm     -e MEILISEARCH_HOST_URL=http://localhost:9494/    -e MEILISEARCH_API_KEY=trantor    -v /Users/silviayuan/test/docs-scraper/config.json:/docs-scraper/config.json meilisearch_chrome  pipenv run ./docs_scraper config.json

After my second step , it throw error.

image

silvia-YQY avatar Apr 14 '22 15:04 silvia-YQY

Are you sure your port is correct? By default Meilisearch runs on port 7700 not 9494.

meilisearch_chrome, this should be the name of the image getmeili/docs-scraper:latest.

docker run -t --rm  -e MEILISEARCH_HOST_URL=http://localhost:9494/ -e MEILISEARCH_API_KEY=trantor -v /Users/silviayuan/test/docs-scraper/config.json:/docs-scraper/config.json getmeili/docs-scraper-latest pipenv run ./docs_scraper config.json

Or did you build a custom image? Based on meilisearch_chrome I am guessing you are trying to scrape a JavaScript rendered page? If so you may still run into issues. Check this issue #139 if that is what you are trying to do.

sanders41 avatar Apr 17 '22 18:04 sanders41

Hi @silvia-YQY, Is any news on your issue? Do you figure out how to fix it?

alallema avatar Sep 21 '22 08:09 alallema

Without news for a while, I close this issue. do not hesitate to reopen it if necessary.

alallema avatar Oct 06 '22 10:10 alallema