0xd34db33f

Results 9 comments of 0xd34db33f

I've seen this before as well and just chalked it up to DNS rate limits (we're pretty much loading up a bunch of domains and firing it off which I've...

Musing as this could help rectify #11 and has database implications from #9 . While we can certainly add a date field to the database entries for found domains, it...

Yeah definitely makes sense to add some good testing functionality to it. Thinking out loud really as I'm not sure where the testing segmentation lies between the wrapping code vs...

Love the idea, should be pretty trivial using requests library, md5'ing the downloaded information, and then checking if it's different than the value in a new table we setup. Only...

Started coding this up using Scrapy a little bit ago. Think I've got something, so I'll take ownership for now.

Ah I see the problem, I had Yara installed previously so it dropped the library on my system. Looks like it requires libyara to be installed on Ubuntu systems (simple...

Thought just occurred to me. The Yara functionality needs to be truly optional especially given the opt-in command line switch. So I went ahead and added a graceful try-except that...

Yeah unfortunately I've never had a situation to test it behind a proxy so this isn't totally unsurprising. Based on the following it should be pretty trivial to add a...

I just uploaded a version that should work with un-authenticated proxies and basic auth proxies. NTLM based proxies are a pain to support in python so I doubt I'll be...