gopa-abandoned
gopa-abandoned copied to clipboard
GOPA, a spider written in Go.(NOTE: this project moved to https://github.com/infinitbyte/gopa )
Gopa

[狗爬], A Spider Written in Go.
Build Gopa
Mac/Linux: Run make build to build the Gopa
Windows: go with this wiki - How to build GOPA on windows
Download
Start Gopa
After download/build the binary file, run ./gopa to start the Gopa
Run ./gopa -h to get the full list of commandline options
- -log option : logging level,can be set to
trace,debug,info,warn,error,default isinfo - -daemon option : run in background as daemon
- -pprof option : enable and setup pprof/expvar service, eg: localhost:6060 , the endpoint will be: http://localhost:6060/debug/pprof/ and http://localhost:6060/debug/vars
- -cpuprofile option : write cpu profile to this file
- -memprofile option : write memory profile to this file
Stop Gopa
It's safety to press ctrl+c stop the current running Gopa, Gopa will handle the rest,saving the checkpoint,
you may restore the job later,the world is still in your hand.
If you are running Gopa as daemon, you can stop it like this:
kill -QUIT `pgrep gopa`
UI
Visit http://127.0.0.1:9001/ for more details.
License
Released under the Apache License, Version 2.0 .