newspaper

newspaper copied to clipboard

Parse only a certain directory

1

Hi! I started using newspaper library and ran into a problem. For example, I want to parse a certain category of a website. I would try to do it like...

savandriy

Categories filters don't work as expected

1

Hi team, I've been trying to extract articles for a particular category https://www.dailymail.co.uk/health/index.html, however it when I check the articles being fetched, I get everything, not just the ones under...

varuncheq

Receving same result for different urls

4

I need to retrive all news from https://news.bitcoin.com. It has pages like this: https://news.bitcoin.com/page/2/. But whatever page I am trying to access I get same results like this: https://news.bitcoin.com/the-satoshi-revolution-by-wendy-mcelroy/ https://news.bitcoin.com/tidbits-peter-todd-on-passphrase-memorization-antonopoulos-explains-transaction-fees/...

Tolkoton

Iterating articles on news source produces duplicates, if subdomain omitted.

1

I was testing news sources, and found that this article was emitted twice, despite the fact that newspaper should be memoizing. The problem seems to be that memoization uses the...

awiebe

tanmay-punekar

Newsweek articles do not download

1

How can I help?

planktonrobo

Maintenance Status?

24

Is this library still being maintained? Thanks

nmcbride

Parsing Incorrectly for Yahoo Finance

4

for article links like | url | action required to view all | | --- | --- | | https://finance.yahoo.com/m/ca7cfbea-6f81-34b7-a482-1f7723376eff/ford-crushes-q3-views-with.html | Read More button | | https://finance.yahoo.com/news/epa-data-shows-tesla-excels-200035538.html | | |...

jtara1

The text content of newspapers seems to be returned as paragraphs separated by two newlines. When doing nlp on this, the tokenizer sometimes thinks a sentence spans across two paragraphs,...

dhgelling

I get problems with some image urls when using news-please: ``` Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/newsplease/crawler/commoncrawl_extractor.py", line 259, in _ _process_warc_gz_file filter_pass, article = self.filter_record(record) File "/opt/coviddash/ingress/covidmarch.py", line...

frankier