FlareSolverr icon indicating copy to clipboard operation
FlareSolverr copied to clipboard

Published 20 hours ago • verified publisher icon FlareSolverr

FlareSolverr 3.0.0 released

Open ngosang opened this issue 1 year ago • 11 comments

I just released:

  • FlareSolverr 3.0.0 => https://github.com/FlareSolverr/FlareSolverr/releases/tag/v3.0.0
    • => docker image flaresolverr/flaresolverr:v3.0.0
  • Jackett 0.20.2486 => https://github.com/Jackett/Jackett/releases/tag/v0.20.2486

With those versions you will be able to bypass Cloudflare (all challenges without CAPTCHA). Tested with YGG and many other sites.

There are some breaking changes in FlareSolverr v3. If you are a developer check out the release notes. If you are installing FlareSolverr from source code, review the readme.

Missing features could be implemented in the future by me or by other contributors. PRs will be accepted.

  • Binaries for Linux / Windows / macOS. It should de possible with => https://pyinstaller.org/en/stable/
  • User cookies support => https://github.com/AeonLucid/FlareSolverr/blob/33249fcde63f8c00847aafa8ee435a8478a39a79/src/flaresolverr_service.py#L322
  • Proxy support
  • Session support
  • Captcha solver (without external paid services) => https://github.com/AeonLucid/FlareSolverr/blob/33249fcde63f8c00847aafa8ee435a8478a39a79/src/flaresolverr_service.py#L390

Thanks @ilike2burnthing @garfield69 for the hard work. Thanks @AeonLucid for give me some ideas.

ngosang avatar Jan 05 '23 01:01 ngosang

Hi, thanks for keeping armv7 support. Just confirming this is working well for me on rpi4 (with yggtorrent)

reyqn avatar Jan 05 '23 01:01 reyqn

Working perfectly here, seems faster at solving than previously too. Down from 16+ sec to around 4-5 sec

Deathnetworks avatar Jan 05 '23 01:01 Deathnetworks

@ngosang Thanks a lot!

I released flaresolverr-git on the Arch Linux AUR with this v3 version.

To release a version (v3.0.0) that is not a git version, it would be great to add the file pyproject.toml in this project?
See PEP 517. You can also use pip-compile to keep the old crap of *.txt files but in a better way.

Can you publish flaresolverr on Pypi? You can do it with hatch.

I was wondering why undetected_chromedriver is not listed as a dep and is managed internally?

HLFH avatar Jan 05 '23 01:01 HLFH

To release a version (v3.0.0) that is not a git version, it would be great to add the file pyproject.toml in this project? See PEP 517. You can also use pip-compile to keep the old crap of *.txt files but in a better way.

I did a bit of refactoring just now on a local copy to achieve this:

  1. rename src to flaresolverr in order to namespace the package appropriately
  2. Move package.json from root folder into flaresolverr so that it can be read by the utils.get_flaresolverr_version() method
  3. Rewrite necessary import statements to use the full package name as per step 1

After that I was able to create a simple pyproject.toml file an successfully install and run the new 3.0.0 version

cwegener avatar Jan 05 '23 01:01 cwegener

PR with the above refactor has been created at #651

cwegener avatar Jan 05 '23 02:01 cwegener

FYI Via Prowlarr Still not working for BT4G, Badasstorrents, Cloudtorrents, idope.se, All of these work fine through the newest version of Jackett.

Seems as though this may be a Prowlarr issue since flaresolverr logs show it thinks it worked. Prowlarr states BT4G and other trackers are blocked by Cloudflare Protection.

2023-01-05 02:33:07 INFO FlareSolverr 3.0.0 2023-01-05 02:33:07 INFO Testing web browser installation... 2023-01-05 02:33:23 INFO FlareSolverr User-Agent: Mozilla/5.0 (X11; Linux armv7l) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36 2023-01-05 02:33:23 INFO Test successful 2023-01-05 02:33:23 INFO Serving on http://0.0.0.0:8191 2023-01-05 02:33:53 INFO 192.168.0.104 GET http://192.168.0.187:8191/ 200 OK 2023-01-05 02:34:49 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://bt4g.org/search/2023', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}} 2023-01-05 02:34:49 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2. 2023-01-05 02:35:02 INFO Challenge detected. Title found: Just a moment... 2023-01-05 02:35:26 INFO Challenge solved! 2023-01-05 02:35:34 INFO Response in 45.71 s 2023-01-05 02:35:34 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK 2023-01-05 02:38:06 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://badasstorrents.nocensor.lol/torrents/date/desc', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}} 2023-01-05 02:38:06 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2. 2023-01-05 02:38:16 INFO Challenge detected. Title found: Just a moment... 2023-01-05 02:38:28 INFO Challenge solved! 2023-01-05 02:38:28 INFO Response in 22.853 s 2023-01-05 02:38:28 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK 2023-01-05 02:41:35 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://ext.to/latest/?order=age&sort=desc', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}} 2023-01-05 02:41:35 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2. 2023-01-05 02:41:52 INFO Challenge not detected! 2023-01-05 02:41:52 INFO Response in 17.387 s 2023-01-05 02:41:52 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK 2023-01-05 02:41:54 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://ext.to/latest/?order=age&sort=desc', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}} 2023-01-05 02:41:54 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2. 2023-01-05 02:42:19 INFO Challenge not detected! 2023-01-05 02:42:19 INFO Response in 24.492 s 2023-01-05 02:42:19 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK 2023-01-05 02:42:21 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://ext.to/latest/2/?order=age&sort=desc', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}} 2023-01-05 02:42:21 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2. 2023-01-05 02:42:36 INFO Challenge detected. Title found: Just a moment... 2023-01-05 02:42:37 INFO Incoming request => POST /v1 body: {'maxTimeout': 180000, 'cmd': 'request.get', 'url': 'https://idope.se/browse.html', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}} 2023-01-05 02:42:37 WARNING Request parameter 'userAgent' was removed in FlareSolverr v2. 2023-01-05 02:42:50 INFO Challenge solved! 2023-01-05 02:42:52 INFO Response in 30.414 s 2023-01-05 02:42:52 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK 2023-01-05 02:42:52 INFO Challenge detected. Title found: Just a moment... 2023-01-05 02:43:01 INFO Challenge solved! 2023-01-05 02:43:02 INFO Response in 24.679 s 2023-01-05 02:43:02 INFO 192.168.0.162 POST http://192.168.0.187:8191/v1 200 OK

davidreverett avatar Jan 05 '23 02:01 davidreverett

It is resolving the challenge in flaresolverr logs 2nd time for hd-space but in jackett it throws error. "Cookies provided are invalid"

Flaresolverr logs:

2023-01-05 15:15:29 INFO Incoming request => POST /v1 body: {'maxTimeout': 55000, 'cmd': 'request.get', 'url': 'https://hd-space.org/index.php?page=login'} 2023-01-05 15:15:36 INFO Challenge not detected! 2023-01-05 15:15:36 INFO Response in 6.885 s 2023-01-05 15:15:36 INFO 172.17.0.1 POST http://localhost:8191/v1 200 OK 2023-01-05 15:15:42 INFO Incoming request => POST /v1 body: {'maxTimeout': 55000, 'cmd': 'request.get', 'url': 'https://hd-space.org/index.php?page=login'} 2023-01-05 15:15:44 INFO Challenge detected. Title found: Just a moment... 2023-01-05 15:15:49 INFO Challenge solved! 2023-01-05 15:15:49 INFO Response in 6.927 s 2023-01-05 15:15:49 INFO 172.17.0.1 POST http://localhost:8191/v1 200 OK

Jackett logs:

01-06 01:15:36 Error FlareSolverrSharp.Exceptions.FlareSolverrException: The cookies provided by FlareSolverr are not valid at FlareSolverrSharp.ClearanceHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Jackett.Common.Utils.Clients.HttpWebClient2.Run(WebRequest webRequest) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/HttpWebClient2.cs:line 179 at Jackett.Common.Utils.Clients.WebClient.GetResultAsync(WebRequest request) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/WebClient.cs:line 186 at Jackett.Common.Indexers.BaseWebIndexer.RequestWithCookiesAsync(String url, String cookieOverride, RequestType method, String referer, IEnumerable1 data, Dictionary2 headers, String rawbody, Nullable1 emulateBrowser) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/BaseIndexer.cs:line 522 at Jackett.Common.Indexers.HDSpace.ApplyConfiguration(JToken configJson) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/HDSpace.cs:line 91 at Jackett.Server.Controllers.IndexerApiController.UpdateConfig(ConfigItem[] config) in /home/vsts/work/1/s/src/Jackett.Server/Controllers/IndexerApiController.cs:line 97 at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask1 actionResultValueTask) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeNextActionFilterAsync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeInnerFilterAsync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeFilterPipelineAsync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope) at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger) at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context) at Jackett.Server.Middleware.CustomExceptionHandler.Invoke(HttpContext httpContext) in /home/vsts/work/1/s/src/Jackett.Server/Middleware/CustomExceptionHandler.cs:line 26 FlareSolverrSharp.Exceptions.FlareSolverrException: The cookies provided by FlareSolverr are not valid at FlareSolverrSharp.ClearanceHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Jackett.Common.Utils.Clients.HttpWebClient2.Run(WebRequest webRequest) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/HttpWebClient2.cs:line 179 at Jackett.Common.Utils.Clients.WebClient.GetResultAsync(WebRequest request) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/WebClient.cs:line 186 at Jackett.Common.Indexers.BaseWebIndexer.RequestWithCookiesAsync(String url, String cookieOverride, RequestType method, String referer, IEnumerable1 data, Dictionary2 headers, String rawbody, Nullable1 emulateBrowser) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/BaseIndexer.cs:line 522 at Jackett.Common.Indexers.HDSpace.ApplyConfiguration(JToken configJson) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/HDSpace.cs:line 91 at Jackett.Server.Controllers.IndexerApiController.UpdateConfig(ConfigItem[] config) in /home/vsts/work/1/s/src/Jackett.Server/Controllers/IndexerApiController.cs:line 97 at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask1 actionResultValueTask) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeNextActionFilterAsync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeInnerFilterAsync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeFilterPipelineAsync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope) at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger) at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context) at Jackett.Server.Middleware.CustomExceptionHandler.Invoke(HttpContext httpContext) in /home/vsts/work/1/s/src/Jackett.Server/Middleware/CustomExceptionHandler.cs:line 26 01-06 01:15:49 Error FlareSolverrSharp.Exceptions.FlareSolverrException: The cookies provided by FlareSolverr are not valid at FlareSolverrSharp.ClearanceHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Jackett.Common.Utils.Clients.HttpWebClient2.Run(WebRequest webRequest) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/HttpWebClient2.cs:line 179 at Jackett.Common.Utils.Clients.WebClient.GetResultAsync(WebRequest request) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/WebClient.cs:line 186 at Jackett.Common.Indexers.BaseWebIndexer.RequestWithCookiesAsync(String url, String cookieOverride, RequestType method, String referer, IEnumerable1 data, Dictionary2 headers, String rawbody, Nullable1 emulateBrowser) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/BaseIndexer.cs:line 522 at Jackett.Common.Indexers.HDSpace.ApplyConfiguration(JToken configJson) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/HDSpace.cs:line 91 at Jackett.Server.Controllers.IndexerApiController.UpdateConfig(ConfigItem[] config) in /home/vsts/work/1/s/src/Jackett.Server/Controllers/IndexerApiController.cs:line 97 at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask1 actionResultValueTask) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeNextActionFilterAsync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeInnerFilterAsync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeFilterPipelineAsync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope) at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger) at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context) at Jackett.Server.Middleware.CustomExceptionHandler.Invoke(HttpContext httpContext) in /home/vsts/work/1/s/src/Jackett.Server/Middleware/CustomExceptionHandler.cs:line 26 FlareSolverrSharp.Exceptions.FlareSolverrException: The cookies provided by FlareSolverr are not valid at FlareSolverrSharp.ClearanceHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Jackett.Common.Utils.Clients.HttpWebClient2.Run(WebRequest webRequest) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/HttpWebClient2.cs:line 179 at Jackett.Common.Utils.Clients.WebClient.GetResultAsync(WebRequest request) in /home/vsts/work/1/s/src/Jackett.Common/Utils/Clients/WebClient.cs:line 186 at Jackett.Common.Indexers.BaseWebIndexer.RequestWithCookiesAsync(String url, String cookieOverride, RequestType method, String referer, IEnumerable1 data, Dictionary2 headers, String rawbody, Nullable1 emulateBrowser) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/BaseIndexer.cs:line 522 at Jackett.Common.Indexers.HDSpace.ApplyConfiguration(JToken configJson) in /home/vsts/work/1/s/src/Jackett.Common/Indexers/HDSpace.cs:line 91 at Jackett.Server.Controllers.IndexerApiController.UpdateConfig(ConfigItem[] config) in /home/vsts/work/1/s/src/Jackett.Server/Controllers/IndexerApiController.cs:line 97 at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask1 actionResultValueTask) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeNextActionFilterAsync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeInnerFilterAsync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeFilterPipelineAsync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope) at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger) at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context) at Jackett.Server.Middleware.CustomExceptionHandler.Invoke(HttpContext httpContext) in /home/vsts/work/1/s/src/Jackett.Server/Middleware/CustomExceptionHandler.cs:line 26

Raul824 avatar Jan 05 '23 15:01 Raul824

It solves fanfiction.net now... occasionaly. At times it gives:

2023-01-08 00:58:20 INFO     FlareSolverr 3.0.1
2023-01-08 00:58:20 INFO     Testing web browser installation...
2023-01-08 00:58:21 INFO     FlareSolverr User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36
2023-01-08 00:58:21 INFO     Test successful
2023-01-08 00:58:21 INFO     Serving on http://0.0.0.0:17860
2023-01-08 00:58:53 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://www.fanfiction.net/u/13790658', 'maxTimeout': 60000}
2023-01-08 00:58:55 INFO     Challenge detected. Title found: Just a moment...
2023-01-08 00:59:54 ERROR    Error: Error solving the challenge. Timeout after 60.0 seconds.
2023-01-08 00:59:54 INFO     Response in 60.674 s
2023-01-08 00:59:54 INFO     127.0.0.1 POST http://127.0.0.1:17860/v1 500 Internal Server Error
2023-01-08 01:00:26 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://www.fanfiction.net/u/13790658', 'maxTimeout': 60000}
2023-01-08 01:00:27 INFO     Challenge detected. Title found: Just a moment...
2023-01-08 01:00:31 INFO     Challenge solved!
2023-01-08 01:00:31 INFO     Response in 4.968 s
2023-01-08 01:00:31 INFO     127.0.0.1 POST http://127.0.0.1:17860/v1 200 OK

Zeks avatar Jan 08 '23 01:01 Zeks

Also, it seems like the flaresovler output now displays japanese symbols as \uXXXX, any way it can be changed?

Zeks avatar Jan 08 '23 01:01 Zeks

But anyway: big big thanks for this version. My project is alive again now :) It's a completely "free time free service" thing so I wouldn't have been able to continue without people providing the parsing access, I am very grateful for your work

Zeks avatar Jan 08 '23 01:01 Zeks

Prowlarr + yggtorrent does not seem to work with the latest FlareSolverr. But Jackett + yggtorrent does seem to work with the latest FlareSolverr.

HLFH avatar Jan 10 '23 15:01 HLFH

@HLFH how did you manage to make it work ? tried latest Jackett +FlareSolverr but I keep getting "Error solving the challeng." on Yggtorrent

This is what I get on v3.0.2

2023-02-01 17:55:27 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'http://www.google.com/', 'maxTimeout': 60000}
2023-02-01 17:55:31 INFO     Challenge not detected!
2023-02-01 17:55:32 INFO     Response in 4.907 s
2023-02-01 17:55:32 INFO     172.17.0.1 POST http://localhost:8191/v1 200 OK
2023-02-01 17:57:35 INFO     Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://www6.yggtorrent.lol', 'maxTimeout': 60000}
2023-02-01 17:57:39 INFO     Challenge detected. Title found: Just a moment...
2023-02-01 17:58:37 ERROR    Error: Error solving the challenge. Timeout after 60.0 seconds.
2023-02-01 17:58:37 INFO     Response in 61.71 s

Thomas-Philippot avatar Feb 01 '23 17:02 Thomas-Philippot

I have the same thing as @Thomas-Philippot.

flaresolverr_1  | 2023-02-01 21:26:43 INFO     ReqId 139630326314752 Incoming request => POST /v1 body: {'maxTimeout': 60000, 'cmd': 'request.get', 'url': 'https://www6.yggtorrent.lol/engine/search?category=all&name=&description=&file=&uploader=&sub_category=&do=search&order=desc&sort=publish_date', 'userAgent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36', 'proxy': {}}
flaresolverr_1  | 2023-02-01 21:26:43 WARNING  ReqId 139630326314752 Request parameter 'userAgent' was removed in FlareSolverr v2.
flaresolverr_1  | 2023-02-01 21:26:43 DEBUG    ReqId 139630326314752 Launching web browser...
flaresolverr_1  | 2023-02-01 21:26:43 DEBUG    ReqId 139630326314752 Started executable: `/app/chromedriver` in a child process with pid: 402
flaresolverr_1  | 2023-02-01 21:26:44 DEBUG    ReqId 139630292743936 Navigating to... https://www6.yggtorrent.lol/engine/search?category=all&name=&description=&file=&uploader=&sub_category=&do=search&order=desc&sort=publish_date
flaresolverr_1  | 2023-02-01 21:26:44 INFO     ReqId 139630292743936 Challenge detected. Title found: Just a moment...
flaresolverr_1  | 2023-02-01 21:26:44 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:26:58 DEBUG    ReqId 139630292743936 Timeout waiting for selector
flaresolverr_1  | 2023-02-01 21:26:58 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:27:08 DEBUG    ReqId 139630292743936 Timeout waiting for selector
flaresolverr_1  | 2023-02-01 21:27:08 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:27:18 DEBUG    ReqId 139630292743936 Timeout waiting for selector
flaresolverr_1  | 2023-02-01 21:27:18 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:27:32 DEBUG    ReqId 139630292743936 Timeout waiting for selector
flaresolverr_1  | 2023-02-01 21:27:32 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:27:42 DEBUG    ReqId 139630292743936 Timeout waiting for selector
flaresolverr_1  | 2023-02-01 21:27:42 DEBUG    ReqId 139630292743936 Waiting for title: Just a moment...
flaresolverr_1  | 2023-02-01 21:27:51 ERROR    ReqId 139630326314752 Error: Error solving the challenge. Timeout after 60.0 seconds.

Zegorax avatar Feb 01 '23 21:02 Zegorax

@Zegorax are you using a VPS or something ? I get the error on a debian VPS.

Works like a charm on my local network using a raspberry pi

Thomas-Philippot avatar Feb 01 '23 23:02 Thomas-Philippot

It's running on Hetzner's network, I'm quite sur that it is the problem. In the past I simply connected to YggTorrent using a remote desktop also running there and it would solve the problem. But now, since a few days, it's not working anymore.

Zegorax avatar Feb 02 '23 09:02 Zegorax

Hello For me impossible to make flaresolverr work on YGGTorrent. The challenge fails Do you have a solution for this?

cdjufer avatar Feb 04 '23 14:02 cdjufer

If you're using Jackett/Prowlarr and FlareSolverr on the same device and the same IP (i.e. no VPN or proxy), with IPv6 disabled, and other indexers which require FlareSolverr are working (TorrentQQ is a quick test), then the issue lies with YGG.

There are plenty of old issues regarding YGG, and they almost all come down to the same thing: their implementation of Cloudflare IAUM protection as a result of them being DDoS'd. There's nothing we can do about that.

ilike2burnthing avatar Feb 04 '23 15:02 ilike2burnthing

It's running on Hetzner's network, I'm quite sur that it is the problem. In the past I simply connected to YggTorrent using a remote desktop also running there and it would solve the problem. But now, since a few days, it's not working anymore.

Can't make it works too on Hetzner, tried on a local server and it's finally working! (Also, Flaresolverr is broken on RaspberryPi 3)

lborruto avatar Feb 07 '23 14:02 lborruto

Idope seems broken, with Jackett v0.20.3269.

023-02-23 13:52:12 INFO     ReqId 139952315868992 FlareSolverr 3.0.2
2023-02-23 13:52:12 DEBUG    ReqId 139952315868992 Debug log enabled
2023-02-23 13:52:12 INFO     ReqId 139952315868992 Testing web browser installation...
2023-02-23 13:52:12 INFO     ReqId 139952315868992 Chrome / Chromium path: /usr/bin/chromium
find: ‘/app/.config/chromium/Crash Reports/pending/’: No such file or directory
2023-02-23 13:52:12 INFO     ReqId 139952315868992 Chrome / Chromium major version: 108
2023-02-23 13:52:12 DEBUG    ReqId 139952315868992 Launching web browser...
2023-02-23 13:52:12 DEBUG    ReqId 139952315868992 Started executable: `/app/chromedriver` in a child process with pid: 31
2023-02-23 13:52:13 INFO     ReqId 139952315868992 FlareSolverr User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36
2023-02-23 13:52:13 INFO     ReqId 139952315868992 Test successful
2023-02-23 13:52:13 INFO     ReqId 139952315868992 Serving on http://0.0.0.0:8191
2023-02-23 13:52:21 INFO     ReqId 139952284428032 Incoming request => POST /v1 body: {'maxTimeout': 55000, 'cmd': 'request.get', 'url': 'https://idope.se/browse.html'}
2023-02-23 13:52:21 DEBUG    ReqId 139952284428032 Launching web browser...
2023-02-23 13:52:21 DEBUG    ReqId 139952284428032 Started executable: `/app/chromedriver` in a child process with pid: 194
2023-02-23 13:52:22 DEBUG    ReqId 139952046208768 Navigating to... https://idope.se/browse.html
2023-02-23 13:52:22 INFO     ReqId 139952046208768 Challenge detected. Title found: Just a moment...
2023-02-23 13:52:22 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:52:32 DEBUG    ReqId 139952046208768 Timeout waiting for selector
2023-02-23 13:52:32 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:52:42 DEBUG    ReqId 139952046208768 Timeout waiting for selector
2023-02-23 13:52:42 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:52:52 DEBUG    ReqId 139952046208768 Timeout waiting for selector
2023-02-23 13:52:52 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:53:02 DEBUG    ReqId 139952046208768 Timeout waiting for selector
2023-02-23 13:53:02 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:53:12 DEBUG    ReqId 139952046208768 Timeout waiting for selector
2023-02-23 13:53:12 DEBUG    ReqId 139952046208768 Waiting for title: Just a moment...
2023-02-23 13:53:17 ERROR    ReqId 139952284428032 Error: Error solving the challenge. Timeout after 55.0 seconds.
2023-02-23 13:53:17 DEBUG    ReqId 139952284428032 Response => POST /v1 body: {'status': 'error', 'message': 'Error: Error solving the challenge. Timeout after 55.0 seconds.', 'startTimestamp': 1677160341421, 'endTimestamp': 1677160397213, 'version': '3.0.2'}
2023-02-23 13:53:17 INFO     ReqId 139952284428032 Response in 55.792 s
2023-02-23 13:53:17 INFO     ReqId 139952284428032 172.17.0.7 POST http://flaresolverr:8191/v1 500 Internal Server Error

samip5 avatar Feb 23 '23 14:02 samip5

The request always has the following problem

{ "status": "error", "message": "Error: Error solving the challenge. Timeout after 60.0 seconds.", "startTimestamp": 1678687474446, "endTimestamp": 1678687535384, "version": "3.0.4" }

jiaochanghaoserverss avatar Mar 13 '23 06:03 jiaochanghaoserverss

Proxy and Cookies support implemented in https://github.com/FlareSolverr/FlareSolverr/releases/tag/v3.2.0

ngosang avatar May 23 '23 22:05 ngosang