petermr

These very long queries are fragile. I have a suspicion that one doesn't have balanced brackets. It's possible that they get truncated somewhere. If you can show it with *much*...

Please can we have a protocol where: * all steps are given in a single place * all data is in named files , not text files on wiki i.e....

# Cannot run `ferret` or `python` wrapper. Running from: https://github.com/petermr/openVirus/tree/ferret/ferret ## environment ``` pm286macbook:ferret pm286$ git branch * ferret master pm286macbook:ferret pm286$ pwd /Users/pm286/projects/openVirus/ferret pm286macbook:ferret pm286$ ls README.md get_data_biorxiv.fql medrxiv_search_download.fql...

Thanks where is `main.go`? On Tue, May 12, 2020 at 3:26 PM Vladimir Fetisov wrote: > @petermr this should work > > go run main.go --param=url:"\"https://www.medrxiv.org/search/n95%252Bmasks\"" --param=dir:"\"n95\"" medrixv_search_download.fql > >...

I get ``` pm286macbook:ferret pm286$ ls README.md get_data_biorxiv.fql medrxiv_search_download.fql scrape.py search_biorxiv.py ferret.log get_data_springer.fql redalyc.fql search.fql search_download_medrxiv.py pm286macbook:ferret pm286$ go run main.go --param=url:"\" https://www.medrxiv.org/search/n95%252Bmasks\"" --param=dir:"\"n95\"" medrixv_search_download.fql stat main.go: no such file...

``` ferret --param=url:"\"https://www.medrxiv.org/search/n95%252Bmasks\"" --param=dir:"\"n95\"" medrxiv_search_download.fql Failed to execute the query initialize driver: failed to initialize driver: could not resolve IP for 127.0.0.1: DOCUMENT(baseUrl+"/search/vaccine",{driver:"cdp"}) at 2:13 pm286macbook:ferret pm286$ ``` On Tue,...

Thanks, will try. On Tue, May 12, 2020 at 7:09 PM Vladimir Fetisov wrote: > To use the cdp driver, you need to run Google Chrome before the ferret. >...

OK, still not quite there: ``` pm286macbook:ferret pm286$ /Applications/Google\ Chrome.app/Contents/MacOS/Google\ Chrome --remote-debugging-port=9222 ``` This brought up a new window which I left open ``` Opening in existing browser session. pm286macbook:ferret...

We need precise indications of what to extract from where. There is no general AI in the system. That may come if enough well defined components are scraped.

When we post Issues we have to take a special approach. It's like writing a record of an experiment. We have to make it clear (including printouts/console logs/files created, etc)....