OF-Scraper icon indicating copy to clipboard operation
OF-Scraper copied to clipboard

download problem

Open yangsss717 opened this issue 7 months ago • 5 comments

After using the ofscraper script, an error occurred:

D:\develop\Python\Lib\site-packages\click\core.py:1193: UserWarning: The parameter -fl is used more than once. Remove its duplicate as parameters should be unique. parser = self.make_parser(ctx) D:\develop\Python\Lib\site-packages\click\core.py:1193: UserWarning: The parameter -ds is used more than once. Remove its duplicate as parameters should be unique. parser = self.make_parser(ctx) D:\develop\Python\Lib\site-packages\click\core.py:1786: UserWarning: The parameter -fl is used more than once. Remove its duplicate as parameters should be unique. rest = super().parse_args(ctx, args) D:\develop\Python\Lib\site-packages\click\core.py:1786: UserWarning: The parameter -ds is used more than once. Remove its duplicate as parameters should be unique. rest = super().parse_args(ctx, args) Traceback (most recent call last): File "", line 198, in run_module_as_main File "", line 88, in run_code File "D:\develop\Python\Scripts\ofscraper.exe_main.py", line 4, in from ofscraper.main import main File "D:\develop\Python\Lib\site-packages\ofscraper_main.py", line 4, in import ofscraper.runner.open.load as load File "D:\develop\Python\Lib\site-packages\ofscraper\runner\open\load.py", line 6, in import ofscraper.runner.open.run as run File "D:\develop\Python\Lib\site-packages\ofscraper\runner\open\run.py", line 7, in from ofscraper.runner.manager import start_manager File "D:\develop\Python\Lib\site-packages\ofscraper\runner\manager.py", line 8, in from ofscraper.data.models.manager import ModelManager File "D:\develop\Python\Lib\site-packages\ofscraper\data\models\manager.py", line 10, in import ofscraper.data.models.utils.retriver as retriver File "D:\develop\Python\Lib\site-packages\ofscraper\data\models\utils\retriver.py", line 7, in import ofscraper.prompts.prompts as prompts File "D:\develop\Python\Lib\site-packages\ofscraper\prompts\prompts.py", line 16, in from ofscraper.prompts.prompt_groups.auth import * File "D:\develop\Python\Lib\site-packages\ofscraper\prompts\prompt_groups\auth.py", line 26, in from ofscraper.utils.auth.utils.warning.print import print_auth_warning File "D:\develop\Python\Lib\site-packages\ofscraper\utils\auth\utils\warning\print.py", line 4, in import ofscraper.utils.auth.request as auth_requests File "D:\develop\Python\Lib\site-packages\ofscraper\utils\auth\request.py", line 25, in import ofscraper.utils.auth.file as auth_file File "D:\develop\Python\Lib\site-packages\ofscraper\utils\auth\file.py", line 18, in import ofscraper.utils.auth.make as make File "D:\develop\Python\Lib\site-packages\ofscraper\utils\auth\make.py", line 10, in import ofscraper.utils.auth.utils.prompt as auth_prompt File "D:\develop\Python\Lib\site-packages\ofscraper\utils\auth\utils\prompt.py", line 17, in import requests File "D:\develop\Python\Lib\site-packages\requests_init_.py", line 43, in import urllib3 File "D:\develop\Python\Lib\site-packages\urllib3_init_.py", line 8, in from .connectionpool import ( ...<3 lines>... ) File "D:\develop\Python\Lib\site-packages\urllib3\connectionpool.py", line 11, in from .exceptions import ( ...<13 lines>... ) File "D:\develop\Python\Lib\site-packages\urllib3\exceptions.py", line 2, in from .packages.six.moves.http_client import ( IncompleteRead as httplib_IncompleteRead ) ModuleNotFoundError: No module named 'urllib3.packages.six.moves'

yangsss717 avatar May 16 '25 16:05 yangsss717

What version of python do you have?

cjb900 avatar May 16 '25 16:05 cjb900

What version of python do you have?

python 3.13.3

yangsss717 avatar May 17 '25 00:05 yangsss717

I've reinstalled python (stable 3.13.3) as also ofscraper (3.12.9) but get the same error at start after I needed to do a fresh windows 11 installation.

`PS C:\WINDOWS\system32> ofscraper C:\Users\XXX\pipx\venvs\ofscraper\Lib\site-packages\click\core.py:1193: UserWarning: The parameter -fl is used more than once. Remove its duplicate as parameters should be unique. parser = self.make_parser(ctx) C:\Users\XXX\pipx\venvs\ofscraper\Lib\site-packages\click\core.py:1193: UserWarning: The parameter -ds is used more than once. Remove its duplicate as parameters should be unique. parser = self.make_parser(ctx) C:\Users\XXX\pipx\venvs\ofscraper\Lib\site-packages\click\core.py:1786: UserWarning: The parameter -fl is used more than once. Remove its duplicate as parameters should be unique. rest = super().parse_args(ctx, args) C:\Users\XXX\pipx\venvs\ofscraper\Lib\site-packages\click\core.py:1786: UserWarning: The parameter -ds is used more than once. Remove its duplicate as parameters should be unique. rest = super().parse_args(ctx, args) [logs.print_system_log:52] Log Level: DEBUG logs.py:52 [logs.print_system_log:53] version: 3.12.9 logs.py:53 [logs.print_system_log:55] config path: C:\Users\your_username.config\ofscraper\config.json logs.py:55 [logs.print_system_log:56] profile path: C:\Users\your_username.config\ofscraper\main_profile logs.py:56 [logs.print_system_log:57] log folder: C:\Users\your_username.config\ofscraper\logging logs.py:57 [logs.print_latest_version:94] OF-Scraper up to date logs.py:94

_______  _______         _______  _______  _______  _______  _______  _______  _______
(  ___  )(  ____ \       (  ____ \(  ____ \(  ____ )(  ___  )(  ____ )(  ____ \(  ____ )
| (   ) || (    \/       | (    \/| (    \/| (    )|| (   ) || (    )|| (    \/| (    )|
| |   | || (__     _____ | (_____ | |      | (____)|| (___) || (____)|| (__    | (____)|
| |   | ||  __)   (_____)(_____  )| |      |     __)|  ___  ||  _____)|  __)   |     __)
| |   | || (                   ) || |      | (\ (   | (   ) || (      | (      | (\ (
| (___) || )             /\____) || (____/\| ) \ \__| )   ( || )      | (____/\| ) \ \__
(_______)|/              \_______)(_______/|/   \__/|/     \||/       (_______/|/   \__/

[close.sendCloseMessage:49] Finished Script close.py:49 PS C:\WINDOWS\system32>`

Lichterflug avatar May 19 '25 17:05 Lichterflug

I've reinstalled python (stable 3.13.3) as also ofscraper (3.12.9) but get the same error at start after I needed to do a fresh windows 11 installation.

`PS C:\WINDOWS\system32> ofscraper C:\Users\XXX\pipx\venvs\ofscraper\Lib\site-packages\click\core.py:1193: UserWarning: The parameter -fl is used more than once. Remove its duplicate as parameters should be unique. parser = self.make_parser(ctx) C:\Users\XXX\pipx\venvs\ofscraper\Lib\site-packages\click\core.py:1193: UserWarning: The parameter -ds is used more than once. Remove its duplicate as parameters should be unique. parser = self.make_parser(ctx) C:\Users\XXX\pipx\venvs\ofscraper\Lib\site-packages\click\core.py:1786: UserWarning: The parameter -fl is used more than once. Remove its duplicate as parameters should be unique. rest = super().parse_args(ctx, args) C:\Users\XXX\pipx\venvs\ofscraper\Lib\site-packages\click\core.py:1786: UserWarning: The parameter -ds is used more than once. Remove its duplicate as parameters should be unique. rest = super().parse_args(ctx, args) [logs.print_system_log:52] Log Level: DEBUG logs.py:52 [logs.print_system_log:53] version: 3.12.9 logs.py:53 [logs.print_system_log:55] config path: C:\Users\your_username.config\ofscraper\config.json logs.py:55 [logs.print_system_log:56] profile path: C:\Users\your_username.config\ofscraper\main_profile logs.py:56 [logs.print_system_log:57] log folder: C:\Users\your_username.config\ofscraper\logging logs.py:57 [logs.print_latest_version:94] OF-Scraper up to date logs.py:94

_______  _______         _______  _______  _______  _______  _______  _______  _______
(  ___  )(  ____ \       (  ____ \(  ____ \(  ____ )(  ___  )(  ____ )(  ____ \(  ____ )
| (   ) || (    \/       | (    \/| (    \/| (    )|| (   ) || (    )|| (    \/| (    )|
| |   | || (__     _____ | (_____ | |      | (____)|| (___) || (____)|| (__    | (____)|
| |   | ||  __)   (_____)(_____  )| |      |     __)|  ___  ||  _____)|  __)   |     __)
| |   | || (                   ) || |      | (\ (   | (   ) || (      | (      | (\ (
| (___) || )             /\____) || (____/\| ) \ \__| )   ( || )      | (____/\| ) \ \__
(_______)|/              \_______)(_______/|/   \__/|/     \||/       (_______/|/   \__/

[close.sendCloseMessage:49] Finished Script close.py:49 PS C:\WINDOWS\system32>`

I faced the same error as you and managed to work around it after checking the logs at C:\Users\your_username\.config\ofscraper\logging.

There was this error in my log

ModuleNotFoundError: No module named 'aiolimiter.compat'

 2025-05-20 22:46:51:[run.main:23]  No module named 'aiolimiter.compat'

I fixed it by referencing the issue 484.

The following were my steps for the fix:

  1. Use Python 3.11.6
  2. Install pipx and reinstall ofscraper as per instructions
  3. Install aiolimiter==1.1.0
pipx inject ofscraper aiolimiter==1.1.0 --force

It could be related to your issue.

dianjinoh avatar May 20 '25 14:05 dianjinoh

You're my superhero. :-D Thanks alot

Lichterflug avatar May 20 '25 17:05 Lichterflug

Following your method I can use the script, but I met another problem and need your help, Thank you!

Set the auth.json file format like this:

{
  "sess": "",
  "auth_id": "",
  "auth_uid": "",
  "user_agent": "",
  "x-bc": "",
  "app-token": ""
}

In your document the format is:

{
    "auth": {
        "sess": "",
        "auth_id": "",
        "auth_uniq_": "",
        "user_agent": "",
        "x-bc": ""
    }
}

yangsss717 avatar May 30 '25 03:05 yangsss717

This info is only printed to console

{ "sess": "", "auth_id": "", "auth_uid": "", "user_agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36", "x-bc": "", "app-token": "" } Dynamic Rule: datawhores

==============================================================

Double check to make sure the [x-bc,user-agent] info is correct

Double check to make sure the [sess, auth_id] info is correct

If 2fa is enabled double check that [auth_uid_] is set and not the same as auth_id

Double check to make sure dynamic rule is as desired

================================================

yangsss717 avatar May 30 '25 03:05 yangsss717

my rules are out of date, try one of the other ones

datawhores avatar May 30 '25 13:05 datawhores

Where can I modify the rule? What other rules are there?

yangsss717 avatar May 30 '25 17:05 yangsss717