scrapy-dotpersistence icon indicating copy to clipboard operation
scrapy-dotpersistence copied to clipboard

add AWS_SESSION_TOKEN to make it works with AWS lambda (need executio…

Open dgouyette-predictice opened this issue 3 years ago • 1 comments
trafficstars

…n role instead of user role)

dgouyette-predictice avatar Mar 28 '22 12:03 dgouyette-predictice

i use scrappy-dotpersistence with scrappy-deltafetch to store result on aws S3. The code run in a lambda. For now i had to provide my personnal credential to make it works. 🥴 I investigated, and lambda use default credentials, and it say, user doesn't exists. It's because AWS lambda use execution role When you make a call using temporary security credentials, the call must include a session token, which is returned along with those temporary credentials. AWS uses the session token to validate the temporary security credentials. see https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_temp_use-resources.html

dgouyette-predictice avatar Apr 04 '22 07:04 dgouyette-predictice