search-tweets-python icon indicating copy to clipboard operation
search-tweets-python copied to clipboard

Cannot access tweets through a ResultStream from behind a proxy

Open finnhacks42 opened this issue 3 years ago • 2 comments

Describe the bug Trying to stream results from behind a proxy fails with a connection refused error.

HTTPS_PROXY and HTTP_PROXY environment variables are set but are ignored by ResultStream due to line 48 in result_stream.py - in make_session session.trust_env=False

To Reproduce From behind a proxy,

os.environ['HTTPS_PROXY']='xxx'
os.environ['HTTP_PROXY']='yyy'
creds = load_credentials('twitter_keys.yml',env_overwrite=False)
rule = gen_rule_payload('beyonce', from_date='2022-01-01',to_date='2022-01-07')
rs = ResultStream(rule_payload=rule,**creds)
tweets = list(rs.stream())

finnhacks42 avatar Jan 24 '22 05:01 finnhacks42

If trusting the contents of the environment variables would break other things, then an option could be created to pass proxy arguments when constructing ResultStream

finnhacks42 avatar Jan 24 '22 05:01 finnhacks42

This is affecting me too. It looks like session.trust_env=False was added by #48 .

bunnyhero avatar Jan 02 '23 03:01 bunnyhero