Dan Chudnov

Related to #163 in making use of /var/log/sfm/*.

Hi Matthew - sfm will attempt to write a new filterstream configuration file in the sfm-specific supervisor.d directory in response to additions or edits to a twitter filter like this...

Good idea; no rush to take it out, and I'd like to keep our docs-focus for m5, so I'm pulling out of m5 for now. Easy add in m6.

perhaps the management commands should make compression optional? might help slightly as the corruption is typically due to a gzip file not being properly closed off.

part of this work (simple user data viz) is proceeding in #44

We do something like this for is_retweet, adding a column to the csv output using our own logic to catch retweets that didn't use twitter's retweet function. Researchers asked for...

Perhaps rethink this as a ticket for stepping through various processing and ensuring that we are writing useful things to the logs when appropriate.

consider caching avatar images for deactivated/deleted accounts. perhaps "update_usernames" should update this as well.

Perhaps a "deactivate" flag rather than "prune". Prune implies deletion, and perhaps loss of data, loss of records. On Oct 30, 2015, at 9:38 AM, Dan Kerchner [email protected] wrote: The...

"is_active" is already there. :) On Oct 30, 2015, at 9:46 AM, Dan Kerchner [email protected] wrote: Yes, hence the title's suggested "disable" action - agreed that we wish to retain...