Martin Adámek
Martin Adámek
Note that we consider those changes breaking; they are planned for the next major version. We already have a branch for that: https://github.com/apify/crawlee/tree/v4
Let's port this guide to the JS version too: https://crawlee.dev/python/docs/guides/http-clients
> AI Agents usually doesn't send text/html in Accept header, but text/markdown or text/plain instead. We can try to serve plain/markdown content right away there. FYI I am already working...
> FYI I am already working on that part. Done via #1997
It should end up as `[contact support](mailto:...)` instead of just the `mailto` link itslef.
This is not just about mailto links, all links have this issue.
Probably related: https://apify.slack.com/archives/C0L33UM7Z/p1764972496690169
The name feels a bit too similar to `crawler.useState()`, which I can imagine we are also missing in python? https://github.com/apify/crawlee/blob/02a598c2a501957f04ca3a2362bcee289ef861c0/packages/basic-crawler/src/internals/basic-crawler.ts#L989
Even if we rename it, this sounds like a bad idea to introduce something completely different with such a similar name. And I would personally not rename it. Its a...
I hope someone can help out with this, never used next.js myself, so I am not the right guy to provide a guide for it.