crawlee-python
crawlee-python copied to clipboard
fix!: merge payload and data fields of Request
Description
- We had
data
andpayload
fields on theRequest
model.-
payload
was not being provided to the HTTP clients, only thedata
field.
-
- ~In this PR, I'm merging them together, keeping only the
data
field (use the same naming asHTTPX
&CurlImpersonate
).~ - In this PR, I'm merging them together, keeping only the
payload
field (use the same naming as in JS Crawlee). - ~I also defined type aliases for HTTP data and HTTP query parameters and used them across the project.~
- ~Some struggle with Pydantic & serialization, but should be OK now...~
Issues
- Reported by @honzajavorek on Slack
- Closes #560
Testing
- The current set of unit tests should cover the changes.
Checklist
- [x] CI passed