ArchivedUltimaScraper icon indicating copy to clipboard operation
ArchivedUltimaScraper copied to clipboard

Error: Please refresh the page

Open lordoffools opened this issue 1 year ago • 34 comments

This started happening this morning (was working fine late last night), perhaps the common data / dynamic rules needs to be refreshed?

Select Site: 0 = onlyfans | 1 = fansly | 2 = starsavn 0 Choose Profile Names: Username = username | 0 = All | 1 = default 0 Auth (V1) Attempt 1/10 Please refresh the page Archive Completed in 0.01 Minutes Pausing scraper for 0 seconds.

Redoing the auth.json doesn't help.

lordoffools avatar Jul 06 '23 18:07 lordoffools

Same here. Started happening about an hour ago.

patchcad avatar Jul 06 '23 19:07 patchcad

I don't know if it's related, but at the same time that the scrapper stoped to work, a new release of dynamic rules has released.

5d9a39a

blackjax696 avatar Jul 06 '23 22:07 blackjax696

Possibly? I thought it was that, actually.

@DIGITALCRIMINALS

lordoffools avatar Jul 06 '23 22:07 lordoffools

It's still broken for you?

DIGITALCRIMINAL avatar Jul 06 '23 22:07 DIGITALCRIMINAL

It's still broken for you?

It is, indeed.

lordoffools avatar Jul 06 '23 22:07 lordoffools

I reverted it, dunno why it doesn't work for the rest of you

DIGITALCRIMINAL avatar Jul 06 '23 22:07 DIGITALCRIMINAL

Both sources stopped working now

@DIGITALCRIMINALS

patchcad avatar Jul 06 '23 22:07 patchcad

I can confirm that it still does not work despite being reverted.

lordoffools avatar Jul 06 '23 22:07 lordoffools

It's working again!

@DIGITALCRIMINALS Bless you for 30 business days!!! 🙏

patchcad avatar Jul 06 '23 22:07 patchcad

Still no joy.

Chromate avatar Jul 06 '23 22:07 Chromate

It's not working for me.

naodrej avatar Jul 06 '23 22:07 naodrej

I changed it back to the updated one because the old one wasn't working .-.

It's working for me now

DIGITALCRIMINAL avatar Jul 06 '23 23:07 DIGITALCRIMINAL

EDIT: Got it working! For those of you using an older version, make sure you go to your .settings\config.json, and set your "dynamic_rules_link" in line 50 to https://raw.githubusercontent.com/DIGITALCRIMINALS/dynamic-rules/main/onlyfans.json

meanjoep92 avatar Jul 06 '23 23:07 meanjoep92

EDIT: Got it working! For those of you using an older version, make sure you go to your .settings\config.json, and set your "dynamic_rules_link" in line 50 to https://raw.githubusercontent.com/DIGITALCRIMINALS/dynamic-rules/main/onlyfans.json

I did that and it's still asking me to refresh page.

DonaldTPP avatar Jul 06 '23 23:07 DonaldTPP

Same. I can confirm that I'm still being asked to refresh page.

lordoffools avatar Jul 07 '23 01:07 lordoffools

Let me know if there's anything I can do to help diagnose why this is working for some and not for others. Happy to help if I can, @DIGITALCRIMINALS

lordoffools avatar Jul 07 '23 01:07 lordoffools

EDIT: Got it working! For those of you using an older version, make sure you go to your .settings\config.json, and set your "dynamic_rules_link" in line 50 to https://raw.githubusercontent.com/DIGITALCRIMINALS/dynamic-rules/main/onlyfans.json

Did not work for me

naodrej avatar Jul 07 '23 01:07 naodrej

EDIT: Got it working! For those of you using an older version, make sure you go to your .settings\config.json, and set your "dynamic_rules_link" in line 50 to https://raw.githubusercontent.com/DIGITALCRIMINALS/dynamic-rules/main/onlyfans.json

I did that and it's still asking me to refresh page.

Try to change the URL on /classes/make_settings.py and /apis/api_helper.py files.

All working here now. Thanks @DIGITALCRIMINALS

blackjax696 avatar Jul 07 '23 01:07 blackjax696

EDIT: Got it working! For those of you using an older version, make sure you go to your .settings\config.json, and set your "dynamic_rules_link" in line 50 to https://raw.githubusercontent.com/DIGITALCRIMINALS/dynamic-rules/main/onlyfans.json

I did that and it's still asking me to refresh page.

Try to change the URL on /classes/make_settings.py and /apis/api_helper.py files.

All working here now. Thanks @DIGITALCRIMINALS

That did it, working now. Thank you!

naodrej avatar Jul 07 '23 01:07 naodrej

EDIT: Got it working! For those of you using an older version, make sure you go to your .settings\config.json, and set your "dynamic_rules_link" in line 50 to https://raw.githubusercontent.com/DIGITALCRIMINALS/dynamic-rules/main/onlyfans.json

I did that and it's still asking me to refresh page.

Try to change the URL on /classes/make_settings.py and /apis/api_helper.py files.

All working here now. Thanks @DIGITALCRIMINALS

Can confirm this version is now working.

DonaldTPP avatar Jul 07 '23 01:07 DonaldTPP

Thank you! I can confirm that changing it in all three locations (.settings/config.json, classes/make_settings.py, and apis/api_helper.py) did the trick!

lordoffools avatar Jul 07 '23 02:07 lordoffools

Guide to solve the issue:

  1. Use Visual Studio Code to open the folder (web version will do)
  2. Click the search button (CTRL + SHIFT + F) and paste https://raw.githubusercontent.com/DATAHOARDERS/dynamic-rules/main/onlyfans.json
  3. Replace the links with this link (CTRL + ENTER): https://raw.githubusercontent.com/DIGITALCRIMINALS/dynamic-rules/main/onlyfans.json

wipeurbuttocks avatar Jul 07 '23 13:07 wipeurbuttocks

Thank you! I can confirm that changing it in all three locations (.settings/config.json, classes/make_settings.py, and apis/api_helper.py) did the trick!

Thanks for listing all 3!! Working now.

fightcancer2 avatar Jul 08 '23 06:07 fightcancer2

None of the above is working for me at all.

All that I get when doing >poetry run python start_us.py is

Choose Subscriptions: 0 = All |

And choosing that returns nothing.

I've even pulled down the source again and started from scratch, having first cleared the pypoetry cache.

Any suggestions on what else I can try?

WillScott73 avatar Jul 08 '23 13:07 WillScott73

Thanks, can confirm changing all 3 worked for me.

drobb0690 avatar Jul 09 '23 20:07 drobb0690

Having stepped through the code in VS Code (setting it up to debug with poetry was challenging!) I discovered that somehow the active setting in auth.json had been set to null, somehow.

So problem solved for me now.

WillScott73 avatar Jul 10 '23 11:07 WillScott73

Having stepped through the code in VS Code (setting it up to debug with poetry was challenging!) I discovered that somehow the active setting in auth.json had been set to null, somehow.

So problem solved for me now.

Ahh ye, if anyone else wants to do it, I just create a python venv the standard way, and then VSCode auto detects it and asks if you'd like to change it

DIGITALCRIMINAL avatar Jul 10 '23 11:07 DIGITALCRIMINAL

Still works, thanks.

escontreras1 avatar Jul 13 '23 19:07 escontreras1

did try the ways that get it fixed. get new error / problem

Type: Profile Type: Stories Traceback (most recent call last): File "C:\Temp\UltimaScraper-7.6.1\start_ofd.py", line 104, in asyncio.run(main()) File "C:\Program Files\Python310\lib\asyncio\runners.py", line 44, in run return loop.run_until_complete(main) File "C:\Program Files\Python310\lib\asyncio\base_events.py", line 646, in run_until_complete return future.result() File "C:\Temp\UltimaScraper-7.6.1\start_ofd.py", line 86, in main api = await main_datascraper.start_datascraper( File "C:\Temp\UltimaScraper-7.6.1\datascraper\main_datascraper.py", line 94, in start_datascraper await main_helper.process_names( File "C:\Temp\UltimaScraper-7.6.1\helpers\main_helper.py", line 966, in process_names result = await module.start_datascraper(authed, username, site_name) File "C:\Temp\UltimaScraper-7.6.1\modules\onlyfans.py", line 161, in start_datascraper await prepare_scraper(authed, site_name, item) File "C:\Temp\UltimaScraper-7.6.1\modules\onlyfans.py", line 784, in prepare_scraper highlights = await subscription.get_highlights() File "C:\Temp\UltimaScraper-7.6.1\apis\onlyfans\classes\create_user.py", line 270, in get_highlights results = [create_highlight(x) for x in results] File "C:\Temp\UltimaScraper-7.6.1\apis\onlyfans\classes\create_user.py", line 270, in results = [create_highlight(x) for x in results] File "C:\Temp\UltimaScraper-7.6.1\apis\onlyfans\classes\create_highlight.py", line 3, in init self.id: int = option.get("id") AttributeError: 'str' object has no attribute 'get'

Fall0n avatar Jul 14 '23 15:07 Fall0n

EDIT: Got it working! For those of you using an older version, make sure you go to your .settings\config.json, and set your "dynamic_rules_link" in line 50 to https://raw.githubusercontent.com/DIGITALCRIMINALS/dynamic-rules/main/onlyfans.json

I did that and it's still asking me to refresh page.

Try to change the URL on /classes/make_settings.py and /apis/api_helper.py files.

All working here now. Thanks @DIGITALCRIMINALS

Thank you so much!

fyhtma avatar Jul 16 '23 01:07 fyhtma