Kyle Maxwell
Kyle Maxwell
For the bad data, sure, we just filter it out. IPv6 is something we should add as a future enhancement because that's eventually going to be relevant, particularly as a...
Exactly. We add the proper regex now in thresher, but winnower can filter it out (more specifically, only pass types it knows about). Or maybe just have IPv6 output as...
I think that's the right way to go. And I'll just use something from http://stackoverflow.com/questions/53497/regular-expression-that-matches-valid-ipv6-addresses ;)
Curious - does anybody have a use case for consuming IPv6 indicators right now? I see a lot more of these in the feeds, though I haven't investigated them yet.
That is in fact what we do. Just thinking about when we should start doing something with them.
I should lrn2read.
We should also handle 502s and whatnot so we can wait a minute and retry.
Also: speedups by making requests in parallel or using sessions / pipelining?
The original part of this is complete, actually. But we **do** need to do the speedup.
There's a remaining documentation component to this, yes?