v2 icon indicating copy to clipboard operation
v2 copied to clipboard

Feedburner "Miniflux generated too many requests to this website."

Open Snake16547 opened this issue 5 months ago • 4 comments

Since a couple days I got following message when refreshing or trying to add a feed which is handled via feedburner

"Miniflux generated too many requests to this website. Please, try again later or change the application configuration. "

My debug info

Version: 2.0.51 Git Commit 7990edd3 Build Date: 2023-12-14T02:01:33+0000 Postgres version: 15.5 (Debian 15.5-1.pgdg120+1) Go version: go1.21.5

Snake16547 avatar Feb 05 '24 12:02 Snake16547

You are probably refreshing the feed too often if you get a 429?

https://github.com/miniflux/v2/blob/ea58bac5489cd71f898312132f6e8d7b42cb4d33/internal/reader/fetcher/response_handler.go#L121-L122

fguillot avatar Feb 10 '24 01:02 fguillot

Sure makes sense but it also doesn't allow me to add any new feeds that are aggregated via which is kind of weird

Snake16547 avatar Feb 10 '24 03:02 Snake16547

I have the same problem, I have many rss feeds on the same website and there are too many requests at the same time, so to solve my problem I changed WORKER_POOL_SIZE to 1 (Default: 5)

SeiyaGame avatar Apr 04 '24 21:04 SeiyaGame

I have many rss feeds on the same website and there are too many requests at the same time

I have the same problem. @fguillot Would it be easy to have each worker serialize fetches per-host, so that those could be pipelined? Instead of having Miniflux have 5 threads connecting to the same host, there would be one connection per-host, and that would not be reused between fetches.

somini avatar Apr 24 '24 18:04 somini