Stephan Akkerman
Stephan Akkerman
We should also consider the amount of unique users that mention the ticker (otherwise 1 user could just spam the timeline by tweeting and retweeting)
Use CCXT to get monthly data?
https://www.coinglass.com/today
Possible to use the bitcoin_data.csv for this
Remove charts and text channels for forex and merge them back to stocks. Nobody tweets about forex ever and it only takes time to process forex tickers seperately
Always use crypto category if the ticker is unknown + scan for common tickers in tweet for instance if the tweet contains BTC / bitcoin, ETH / ethereum, altcoins etc.
warnings for exceptions that are caught
logging.info for prints and logging.warning for exceptions logging.debug for more information than logging.info: for instance to print each tweet it processes and all other relevant steps during debugging
closed with latest commit
I think this will be better as a separate repo, also updating the scraper code and maybe publishing that here too