colly

colly copied to clipboard

Expand GitHub Actions

4

I thought it would be nice to expand the GitHub Actions to support automatic tag incrementing based on commit messages (using [svu](https://github.com/caarlos0/svu?tab=readme-ov-file#commit-messages-vs-what-they-do)) and automatic push of some builds to the...

amarcum

robotsMap memory continues to grow

1

Hello, I am using colly to visit some websites and set `c.IgnoreRobotsTxt = false`. As it runs, you will observe that the **memory continues to grow** over a relatively long...

ZigHuang

A website I'm trying to scrape with Colly relies on having multiple values by the same key. This is supported by `url.Values` and it's what `createFormReader` uses, but we're limited...

ngc

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.17.0 to 0.23.0. Commits c48da13 http2: fix TestServerContinuationFlood flakes 762b58d http2: fix tipos in comment ba87210 http2: close connections when receiving too many headers ebc8168 all: fix...

dependabot[bot]

Resolve the issue of retrying redirectable connections, where the link has already been visited, resulting in the error "AlreadyVisitedUrl". This change cannot avoid the "AlreadyVisitedUrl" error caused by the initial...

Shinku-Chen