data_science icon indicating copy to clipboard operation
data_science copied to clipboard

Url is updating every loop

Open Zackary111 opened this issue 1 year ago • 0 comments

Hi Otavio.

First off, you have created really intutive code to scrape medium. Theres only a small issue, in line 26 you have url = f'{url}/archive/{year}/{month}/{day}', so the url updates every cycle.

For example if url = https://medium, then in the second intteration of the loop,
'url = https://medium/archive/{year}/{month}/{day}/archive/{year}/{month}/{day}'. You likely aren't updating this anymore, but if you are, its a quick fix!

Zackary111 avatar Feb 13 '24 22:02 Zackary111