docudigger icon indicating copy to clipboard operation
docudigger copied to clipboard

OTP Required by Amazon, Scraper Fails to Retrieve Orders

Open maxkpower opened this issue 1 year ago • 5 comments

First and foremost, thank you sooo, so much for this project - i cant wait to get it up and running!

I'm using the npm package to scrape Amazon orders. Even though I don't have 2FA enabled, Amazon is requiring OTP (i'm receiving codes via SMS).

For some reason the logs show that the scraper logs in successfully, but then no orders are retrieved.

[warn] [2024-09-06 00:09:21] [scrape:amazon]: 	No latest orders. OnlyNew deactivated.
[info] [2024-09-06 00:09:28] [scrape:amazon]: 	Logged in
[info] [2024-09-06 00:09:29] [scrape:amazon]: 	First possible year: 2024
[info] [2024-09-06 00:09:29] [scrape:amazon]: 	Last possible year: 2024
[error] [2024-09-06 00:09:31] [scrape:amazon]: 	Couldn't get orderPageCount 1 within 2000ms. Assume only one page.
[info] [2024-09-06 00:09:31] [scrape:amazon]: 	Page count: 1
[info] [2024-09-06 00:09:31] [scrape:amazon]: 	Processing year "2024" page 0
[info] [2024-09-06 00:09:31] [scrape:amazon]: 	Checking page 0 for orders
[info] [2024-09-06 00:09:31] [scrape:amazon]: 	Got 0 orders. Processing...
[info] [2024-09-06 00:09:31] [scrape:amazon]: 	Page "0" done. Skipping to next page.
[info] [2024-09-06 00:09:32] [scrape:amazon]: 	Year "2024" done. Skipping next years
[info] [2024-09-06 00:09:32] [scrape:amazon]: 	Processing done. Processed 0 invoices in 0.00 minutes.
[info] [2024-09-06 00:09:32] [scrape:amazon]: 	Recurring activated. Not terminating. Waiting for next run.

maxkpower avatar Sep 06 '24 00:09 maxkpower

Could you send me the config (it will be put out when log level is DEBUG)? Please be aware to remove your mail and pass :)

Disane87 avatar Sep 09 '24 06:09 Disane87

Same error here… looks like, if we cant completely deactivate 2FA in Amazon Account. 2FA is deactived in Amazon Account but still sends sms with OTP. config is the original from your docker example … -e AMAZON_USERNAME='[ MAIL]'
-e AMAZON_PASSWORD='[ PW]'
-e AMAZON_TLD='de'
-e AMAZON_YEAR_FILTER='2024'
-e AMAZON_PAGE_FILTER='1'
-e LOG_LEVEL='debug'

stefano1986 avatar Sep 22 '24 10:09 stefano1986

I've faced the same issue in another task. 2FA was off and Passkeys were also deactivated. After opening amazon with a an inprivate session of a random browser that issue was magically gone.

But if that persists, I cureently don't have any idea to get over this.

Disane87 avatar Oct 29 '24 14:10 Disane87

I have 2FA enabled and won't deactivate them. Give it a possible way to get invoices? Like API-Token or Passkey or what ever?

And 2nd, give it an interface to paperless-ngx?

svalcken avatar Mar 19 '25 13:03 svalcken

I have 2FA enabled and won't deactivate them. Give it a possible way to get invoices? Like API-Token or Passkey or what ever?

And 2nd, give it an interface to paperless-ngx?

Currently there is no way around 2fa.

If you download your invoices directly into the consume folder of paperless, they will be gathered and processed by it. You only need to mount both folders in paperless and docudigger.

Disane87 avatar Mar 19 '25 13:03 Disane87

Hi, @maxkpower. I'm Dosu, and I'm helping the docudigger team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • The Amazon order scraper fails due to an unexpected OTP requirement, even with 2FA disabled.
  • @Disane87 requested configuration details to diagnose the issue, and @stefano1986 confirmed the same problem.
  • A workaround using an in-private browser session was suggested by @Disane87, but it's not a permanent fix.
  • @svalcken asked about accessing invoices without disabling 2FA, but no bypass method is currently available.

Next Steps:

  • Please confirm if this issue is still relevant to the latest version of the docudigger repository by commenting here.
  • If there is no response, the issue will be automatically closed in 7 days.

Thank you for your understanding and contribution!

dosubot[bot] avatar Jun 18 '25 16:06 dosubot[bot]