Sublist3r some problem about [fleetcaptain/Turbolist3r]

some problem about fleetcaptain/Turbolist3r C:\Users\test\Documents\test\Turbolist3r>python2 turbolist3r.py -v --debug -a -d 123123123.com

Debugging output enabled for analysis module

           _____            _           _ _     _   _____
          |_   _|_   _ _ __| |__  ____ | (_)___| |_|___ / _ __
            | | | | | | `__|  _ \/    \| | / __| __| |_ \| '__|
            | | | \_| | |  | |_) | () || | \__ \ |_ ___) | |
            |_|  \____|_|  |_.__/\____/|_|_|___/\__|____/|_|

          # Based on Sublist3r by Ahmed Aboul-Ela - @aboul3la
          # Forked by Carl Pearson - github.com/fleetcaptain

[-] Enumerating subdomains now for 123123123.com
[-] verbosity is enabled, will show the subdomains results in realtime
[-] Searching now in Baidu..
[-] Searching now in Yahoo..
[-] Searching now in Google..
[-] Searching now in Bing..
[-] Searching now in Ask..
[-] Searching now in Netcraft..
[-] Searching now in DNSdumpster..
[-] Searching now in Virustotal..
[-] Searching now in ThreatCrowd..
[-] Searching now in SSL Certificates..
[-] Searching now in PassiveDNS..
Traceback (most recent call last):
  File "turbolist3r.py", line 1143, in <module>
    engines=engines)
  File "turbolist3r.py", line 986, in main
    enum.start()
  File "C:\Python27\lib\multiprocessing\process.py", line 130, in start
    self._popen = Popen(self)
  File "C:\Python27\lib\multiprocessing\forking.py", line 277, in __init__
    dump(process_obj, to_child, HIGHEST_PROTOCOL)
  File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump
    ForkingPickler(file, protocol).dump(obj)
  File "C:\Python27\lib\pickle.py", line 224, in dump
    self.save(obj)
  File "C:\Python27\lib\pickle.py", line 331, in save
    self.save_reduce(obj=obj, *rv)
  File "C:\Python27\lib\pickle.py", line 425, in save_reduce
    save(state)
  File "C:\Python27\lib\pickle.py", line 286, in save
    f(self, obj) # Call unbound method with explicit self
  File "C:\Python27\lib\pickle.py", line 655, in save_dict
    self._batch_setitems(obj.iteritems())
  File "C:\Python27\lib\pickle.py", line 687, in _batch_setitems
    save(v)
  File "C:\Python27\lib\pickle.py", line 306, in save
    rv = reduce(self.proto)
TypeError: can't pickle thread.lock objects

C:\Users\test\Documents\test\Turbolist3r>Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Python27\lib\multiprocessing\forking.py", line 381, in main
    self = load(from_parent)
  File "C:\Python27\lib\pickle.py", line 1384, in load
    return Unpickler(file).load()
  File "C:\Python27\lib\pickle.py", line 864, in load
    dispatch[key](self)
  File "C:\Python27\lib\pickle.py", line 886, in load_eof
    raise EOFError
EOFError

Ctrl + C C:\Users\test\Documents\test\Turbolist3r> and.. can't it run in python3? So.. in this case, I am using python2 to run it.

Jan 11 '19 11:01 687766616e

$ python turbolist3r.py
  File "turbolist3r.py", line 1137
    print(B + "[-] Reading subdomains from " + inputfile + W)
                                                            ^
TabError: inconsistent use of tabs and spaces in indentation

$ python2 turbolist3r.py

           _____            _           _ _     _   _____
          |_   _|_   _ _ __| |__  ____ | (_)___| |_|___ / _ __
            | | | | | | `__|  _ \/    \| | / __| __| |_ \| '__|
            | | | \_| | |  | |_) | () || | \__ \ |_ ___) | |
            |_|  \____|_|  |_.__/\____/|_|_|___/\__|____/|_|

          # Based on Sublist3r by Ahmed Aboul-Ela - @aboul3la
          # Forked by Carl Pearson - github.com/fleetcaptain

Usage: python turbolist3r.py [Options] use -h for help
Error: argument -d/--domain is required

Mar 02 '19 02:03 687766616e

HTTPSConnectionPool(host='dnsdumpster.com', port=443): Read timed out. (read timeout=25)
Process DNSdumpster-8:
Traceback (most recent call last):
  File "/data/data/com.termux/files/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap
    self.run()
  File "turbolist3r.py", line 289, in run
    domain_list = self.enumerate()
  File "turbolist3r.py", line 669, in enumerate
    self.extract_domains(post_resp)
  File "turbolist3r.py", line 681, in extract_domains
    results_tbl = tbl_regex.findall(resp)[0]
TypeError: expected string or buffer

Mar 02 '19 03:03 687766616e

https://play.google.com/store/apps/details?id=com.termux android 8.0.0 Linux localhost 4.4.78-perf-gdaac017 #1 SMP PREEMPT Fri Feb 15 21:20:47 CST 2019 aarch64 Android

$ python3 turbolist3r.py -h
  File "turbolist3r.py", line 1137
    print(B + "[-] Reading subdomains from " + inputfile + W)
                                                            ^
TabError: inconsistent use of tabs and spaces in indentation

https://github.com/fleetcaptain/Turbolist3r

@fleetcaptain

Mar 11 '19 04:03 687766616e

@huitc Thanks for reporting this, sorry for the delay. I converted turbolist3r.py to fully use tab indentation instead of mix tab/spaces, so that should help there. I ran in python3 and received an error about encoding and hashing (Netcraft module, around line 575) which I believe I've fixed.

It looks like you are running on Windows and Android? Windows is not supported at this time and I wouldn't think Android has a typical python environment, so that might explain some of your errors. It might work, I just haven't tested on either platform. Have you replicated this behavior in a desktop Linux distro?

Mar 17 '19 03:03 fleetcaptain

win10:

$ python3 turbolist3r.py -v -a -d test.us

           _____            _           _ _     _   _____
          |_   _|_   _ _ __| |__  ____ | (_)___| |_|___ / _ __
            | | | | | | `__|  _ \/    \| | / __| __| |_ \| '__|
            | | | \_| | |  | |_) | () || | \__ \ |_ ___) | |
            |_|  \____|_|  |_.__/\____/|_|_|___/\__|____/|_|

          # Based on Sublist3r by Ahmed Aboul-Ela - @aboul3la
          # Forked by Carl Pearson - github.com/fleetcaptain

[-] Enumerating subdomains now for test.us
[-] verbosity is enabled, will show the subdomains results in realtime
[-] Searching now in Baidu..
[-] Searching now in Yahoo..
[-] Searching now in Google..
[-] Searching now in Bing..
[-] Searching now in Ask..
[-] Searching now in Netcraft..
[-] Searching now in DNSdumpster..
[-] Searching now in Virustotal..
[-] Searching now in ThreatCrowd..
[-] Searching now in SSL Certificates..
[-] Searching now in PassiveDNS..
Traceback (most recent call last):
  File "turbolist3r.py", line 1141, in <module>
    res = main(domain, threads, savefile, ports, silent=False, verbose=verbose, enable_bruteforce=enable_bruteforce,engines=engines)
  File "turbolist3r.py", line 985, in main
    enum.start()
  File "C:\Users\HUI\AppData\Local\Programs\Python\Python37-32\lib\multiprocessing\process.py", line 112, in start
    self._popen = self._Popen(self)
  File "C:\Users\HUI\AppData\Local\Programs\Python\Python37-32\lib\multiprocessing\context.py", line 223, in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "C:\Users\HUI\AppData\Local\Programs\Python\Python37-32\lib\multiprocessing\context.py", line 322, in _Popen
    return Popen(process_obj)
  File "C:\Users\HUI\AppData\Local\Programs\Python\Python37-32\lib\multiprocessing\popen_spawn_win32.py", line 65, in __init__
    reduction.dump(process_obj, to_child)
  File "C:\Users\HUI\AppData\Local\Programs\Python\Python37-32\lib\multiprocessing\reduction.py", line 60, in dump
    ForkingPickler(file, protocol).dump(obj)
TypeError: can't pickle _thread.lock objects

HUI@HUITC716 C:\Users\HUI\Documents\huitc\Turbolist3r
$ Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Users\HUI\AppData\Local\Programs\Python\Python37-32\lib\multiprocessing\spawn.py", line 99, in spawn_main
    new_handle = reduction.steal_handle(parent_pid, pipe_handle)
  File "C:\Users\HUI\AppData\Local\Programs\Python\Python37-32\lib\multiprocessing\reduction.py", line 82, in steal_handle
    _winapi.PROCESS_DUP_HANDLE, False, source_pid)
OSError: [WinError 87] Parameter error。

but it works for wsl kali

Mar 17 '19 04:03 687766616e

Thanks. I haven't tested Turbolist3r on Windows and don't plan to support Windows at this time, although you are welcome to submit a pull request if you can get it working. I was going to suggest WSL as something to try, glad it runs successfully in WSL for you as a workaround.

Mar 18 '19 16:03 fleetcaptain

Traceback (most recent call last):
  File "turbolist3r.py", line 1141, in <module>
    res = main(domain, threads, savefile, ports, silent=False, verbose=verbose, enable_bruteforce=enable_bruteforce,engines=engines)
  File "turbolist3r.py", line 1003, in main
    bruteforce_list = subbrute.print_target(parsed_domain.netloc, record_type, subs, resolvers, process_count,
NameError: name 'subbrute' is not defined

python3 turbolist3r.py -v -a -d hidden.com -b using latest version @fleetcaptain

Mar 25 '19 15:03 687766616e

@fleetcaptain

HTTPSConnectionPool(host='dnsdumpster.com', port=443): Read timed out. (read timeout=25)
Process DNSdumpster-8:
Traceback (most recent call last):
  File "/data/data/com.termux/files/usr/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
    self.run()
  File "turbolist3r.py", line 289, in run
    domain_list = self.enumerate()
  File "turbolist3r.py", line 668, in enumerate
    self.extract_domains(post_resp)
  File "turbolist3r.py", line 680, in extract_domains
    results_tbl = tbl_regex.findall(resp)[0]
TypeError: expected string or bytes-like object

Apr 15 '19 14:04 687766616e

For the issue NameError: name 'subbrute' is not defined, is the subbrute library installed on that machine? Seems like it isn't.

For the second issue... are you running the script on Android? The path /data/data/com.termux/... seems like an Android file path. I have not tried this script on Android, or even getting python on Android, and would expect some irregularities between it and standard Linux platforms.

That said, the specific error seems to indicate possible network error talking to dnsdumpster but I just ran the script on my Ubuntu system with no errors. So not sure what is happening. Try checking if your device can browse or otherwise access dnsdumpster.com:443.

Apr 19 '19 04:04 fleetcaptain

https://play.google.com/store/apps/details?id=com.termux

Apr 22 '19 18:04 687766616e

@fleetcaptain can't search by google now?...

Jun 09 '19 10:06 687766616e

If you run the script multiple times in a short window, Google temporarily bans your IP. If that is what is happening, you should be able to run it again after a while and it should work again.

But without the exact error message it's hard to say. Can you provide output?

Jun 09 '19 14:06 fleetcaptain

@fleetcaptain you can search with google? ^^'' (just try pls!!!

Jun 09 '19 16:06 687766616e

Screenshot_2019-06-22-22-56-55-062_com termux

@fleetcaptain pls solve the issu

Jun 22 '19 17:06 iamsaptarshi07

Use a proxy?

On Sat, Jun 22, 2019, 7:29 PM saptoh [email protected] wrote:

[image: Screenshot_2019-06-22-22-56-55-062_com termux] https://user-images.githubusercontent.com/52109778/59966961-1472ee00-9541-11e9-9182-a839e5f5ef91.png

@fleetcaptain https://github.com/fleetcaptain pls solve the issu

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/aboul3la/Sublist3r/issues/163?email_source=notifications&email_token=AANL7O2QZRJQJ75IZIVPFS3P3ZON3A5CNFSM4GPNDZSKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYKN47I#issuecomment-504684157, or mute the thread https://github.com/notifications/unsubscribe-auth/AANL7O6NGA62K44UQKJPIWDP3ZON3ANCNFSM4GPNDZSA .

Jun 22 '19 20:06 petitkriket

https://github.com/notifications/unsubscribe-auth/AANL7O6NGA62K44UQKJPIWDP3ZON3ANCNFSM4GPNDZSA

it's showing that this unsubscribe link isn't valid for my account Screenshot_2019-06-26-15-32-32-568_com android chrome @petitkriket

Jun 26 '19 10:06 iamsaptarshi07

@fleetcaptain請解決問題

https://github.com/aboul3la/Sublist3r/issues/163#issuecomment-476246719 same problem... t.t

Jun 27 '19 01:06 687766616e

Process AskEnum-6:
Traceback (most recent call last):
  File "/data/data/com.termux/files/usr/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
    self.run()
  File "turbolist3r.py", line 309, in run
    domain_list = self.enumerate()
  File "turbolist3r.py", line 281, in enumerate
    links = self.extract_domains(resp)
  File "turbolist3r.py", line 442, in extract_domains
    return links_list
UnboundLocalError: local variable 'links_list' referenced before assignment

-v -a -d xxx.com -o xxx.com.txt @fleetcaptain

Jul 15 '19 16:07 687766616e

can you support fofa.so ??? @fleetcaptain @aboul3la

Jul 16 '19 07:07 687766616e

Process AskEnum-6:
Traceback (most recent call last):
  File "/data/data/com.termux/files/usr/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
    self.run()
  File "turbolist3r.py", line 309, in run
    domain_list = self.enumerate()
  File "turbolist3r.py", line 281, in enumerate
    links = self.extract_domains(resp)
  File "turbolist3r.py", line 442, in extract_domains
    return links_list
UnboundLocalError: local variable 'links_list' referenced before assignment

-v -a -d xxx.com -o xxx.com.txt @fleetcaptain

Did you resovle the problem about "local variable 'links_list'"?

Aug 19 '19 07:08 r1ght0us

@687766616e For some reason Github only notified me about this thread today, I'm sorry for the late reply guys. It appears the subbrute module import statement was commented out. I don't remember why I did this, so I have uncommented it out and pushed a commit to the repository. Brute force should be working again.

Aug 20 '19 03:08 fleetcaptain

As for the links_list issue... I cannot reproduce on Ubuntu 18.04. I see in the provided output you appear to be running the script on Android and I don't support mobile OS at this time. These kinds of quirks tend to pop up so I recommend running the script on a desktop Linux distribution. That said, if you can reproduce the issue on a desktop flavor of Linux please feel free to open an issue at https://github.com/fleetcaptain/Turbolist3r.

Aug 20 '19 03:08 fleetcaptain

If you have an Android phone, I hope you can test it on that phone. ^^'' @fleetcaptain

Aug 23 '19 11:08 687766616e

Screenshot_2022-11-14_14-52-23

Nov 14 '22 15:11 W0DAH5

@fleetcaptain whats gone wrong?

Nov 14 '22 16:11 W0DAH5

@W0DAH5 The site ptrarchive.com appears to no longer exist. The tool should probably be updated to no longer attempt connection to it, but I don't know if/when I will get time to do that.

Jan 23 '23 16:01 fleetcaptain

Sublist3r Sublist3r copied to clipboard

some problem about [fleetcaptain/Turbolist3r]

Sublist3r
Sublist3r copied to clipboard