puppeteer-extra
puppeteer-extra copied to clipboard
[Idea] List of detection tests in docs
Not sure if there's any unforeseen downsides to this idea, but it would be great if there was a way for users to submit new detection tests they find so that developers can improve their Puppeteer apps by running tests against real products.
I've been working on a Plugin that runs the tests that I've identified so far but it would be good to get a more complete list of detection examples from the community.
The ones I have so far:
- Distill Networks http://promos.rtm.com
- Sannysoft https://bot.sannysoft.com
- SocialNetDefender http://anonymity.space/hellobot.php
- Are You Headless? https://arh.antoinevastel.com/bots/areyouheadless
- Fingerprint2 https://fingerprintjs.com/demo
- Datadome https://datadome.co
- Recaptcha3 https://antcpt.com/eng/information/demo-form/recaptcha-3-test-score.html
- Recaptcha https://recaptcha-demo.appspot.com/recaptcha-v3-request-scores.php
- BrowserLeaks https://browserleaks.com/webgl
- PixelScan https://pixelscan.net
Any others people know of would be awesome!
Submitted
- F5 Network https://ib.bri.co.id/ib-bri (tenkuken)
- WhiteOps https://smitop.com/post/whiteops-data (evading-bot-detection)
Edit 1:
Example of how to test against them
Here is a really basic demo of how you might test each detection:
https://github.com/prescience-data/puppeteer-botcheck
F5 Network Bot Defense https://ib.bri.co.id/ib-bri/
This is useful. Can someone also add the tests for WhiteOps?
https://smitop.com/post/whiteops-data/
I like the idea but most of these sites/links are not bot detection tests? :-)
Some of the products such as Datadome have no public "demos" that I know of, so the idea is to build up your tests like this:
https://github.com/prescience-data/puppeteer-botcheck
PerimeterX: https://www.usa-people-search.com/names/a_1_150_0
@berstend These sites (well, most of them) are clients of bot detection companies. If you visit them with, say, window.callPhantom exposed, you will get redirected to a page that will make you do a captcha.
The first link one does not show Distill Networks operating anymore.
But a good example is given by WesternUnion
Getting a non-empty change rate in #smoExchangeRate
means Distill Networks is bypassed (which currently not the case with latest stealth in headless mode)
But a good example is given by WesternUnion
I'd say they're more on the extreme end of the gaussian curve of anti-bot 😄
@drzraf Can you nowadays return that #smoExchangeRate?