centipede-crawler icon indicating copy to clipboard operation
centipede-crawler copied to clipboard

Session authentification

Open jjsaunier opened this issue 9 years ago • 3 comments

Related to umpirsky/centipede#8.

  • Add session auth + allow custom implementation
  • Add ignore URLs (compatible with yml file umpirsky/centipede#2)

Now looks like :

public function __construct($baseUrl, $depth = 1, $ignoreUrl = array(),  AuthenticatorInterface $authenticator = null) 

What do you think ?

jjsaunier avatar Dec 17 '14 17:12 jjsaunier

Hi @ProPheT777, thanks for your PR.

I would like to support list of ignore urls on centipede config file level, not on crawler level.

Regarding authentication, need to think a bit...

umpirsky avatar Dec 17 '14 17:12 umpirsky

Yeah authentication need more reflection but it's a first approach, currently I take the more simple way to achieve it.

I'm working to move exlude urls logic directly on the callback via yml

jjsaunier avatar Dec 17 '14 18:12 jjsaunier

:+1:

umpirsky avatar Dec 17 '14 20:12 umpirsky