Nirbhay Kundan

Adding support for issue #182

3

Adding support for 1.Custom Headers and Cookies with Initial request 2.Shared cookies middleware to share cookies between crawl nodes Linked Issue #182

Support for custom header and cookies for the initial request from kafka_monitor.py feed

5

I needed to request an URL with custom header and preset cookies. eg. There is an API at `https://xyz.com/test_api/_id` which returns a json. and this should be called with api...

`return "http://" + this.bucket.toLowerCase() + **".s3.amazonaws.com/"** + this.objectName; ` Need a setter method to configure region. Will send a pull request if I get time.