JAVMovieScraper icon indicating copy to clipboard operation
JAVMovieScraper copied to clipboard

Scrapper for DMM Seems to be Broken

Open rickytor81 opened this issue 4 years ago • 18 comments

The scrapper for DMM appears to be broken. Would be great if it can be fixed.

Thanks

rickytor81 avatar Jul 16 '20 04:07 rickytor81

Broken due to age check on DMM.jo.co site.

Pull request to handle the age check: #326

zuko7177 avatar Jul 29 '20 06:07 zuko7177

The scrapper for DMM appears to be broken. Would be great if it can be fixed.

Thanks

I have the same problem as yours, the DMM can not be accessed for one month.

huihuijordan avatar Aug 13 '20 00:08 huihuijordan

Broken due to age check on DMM.jo.co site.

Pull request to handle the age check: #326

Could you please give me a working release jar? Many thanks, [email protected]

huihuijordan avatar Aug 13 '20 00:08 huihuijordan

Broken due to age check on DMM.jo.co site.

Pull request to handle the age check: #326

Hi, I cloned the master branch from your repository. I run gradle shadowJar and produced a .jar file. But the DMM is still broken for me.

koonfoon avatar Aug 14 '20 08:08 koonfoon

DMM scraper may still be broken because it uses grammarchecker.net to do JP to EN translations. I've observed that site is not reliable (perhaps due to too many calls?). If the call to that site returns nothing, DMM scraper will not have English data.

Try enabling Preference -> Translation -> Scrape JAV Movies in Japanese Instead Of English

If DMM scraper returns JP data, then you know the translation is down. You can try waiting a day to see if EN translation is working again.

zuko7177 avatar Aug 14 '20 14:08 zuko7177

I just tested DMM scraping and the translation feature is not working. Indeed, this is due to grammarcheck.net not returning translations. It will look like this: image

I also went to test https://grammarchecker.net/translate/ and the translation feature is not working.

DMM scraping in JP is working OK. image

zuko7177 avatar Aug 14 '20 14:08 zuko7177

DMM may still be broken because it uses grammarchecker.net to do JP to EN translations. I've observed that site is not reliable (perhaps due to too many calls?). If the call to that site returns nothing, DMM will not have English data.

Try enabling Preference -> Translation -> Scrape JAV Movies in Japanese Instead Of English

If DMM returns JP data, then you know the translation is down. You can try waiting a day to see if EN translation is working again.

Thank you 👍

koonfoon avatar Aug 15 '20 02:08 koonfoon

@koonfoon : Hello, can you share me your jar file, i'm trying to build a jar file but no luck, thank you very much.

JK0304 avatar Aug 20 '20 10:08 JK0304

Hi @koonfoon, which JDK you used to setup this project? sorry I know it is dumb question, I really not familiar with java @@ I have no luck trying with intellij + jdk 11 in windows 10

Thanks in advanced

neko29ssn avatar Aug 22 '20 01:08 neko29ssn

@JK0304 @neko29ssn This is how I successfully built the jar. I don't have any IDE. My JDK version is 11.0.8 and Gradle is at version 5.6.4. I cloned zuko7177's fork (https://github.com/zuko7177/JAVMovieScraper) and then run "gradle shadowjar" to build the jar. The output jar file is located in build/libs/ folder. Hope this helps.

tonyzzz321 avatar Aug 23 '20 05:08 tonyzzz321

@tonyzzz321 : I successfully create a jar file thanks for your guide but bad new is i can't open it, hope you can help me out. Untitled

JK0304 avatar Aug 23 '20 08:08 JK0304

@JK0304 @neko29ssn This is how I successfully built the jar. I don't have any IDE. My JDK version is 11.0.8 and Gradle is at version 5.6.4. I cloned zuko7177's fork (https://github.com/zuko7177/JAVMovieScraper) and then run "gradle shadowjar" to build the jar. The output jar file is located in build/libs/ folder. Hope this helps.

It work like a charm :D Thank you so much @tonyzzz321 !!

neko29ssn avatar Aug 23 '20 17:08 neko29ssn

@JK0304 Can you run "gradle -v" to see what version of Gradle you have? Make sure you have version 5.6.4, not the latest version. I think the new version of Gradle updated something on how to configure the build, and JAVMovieScraper hasn't been updated hence not compatible with new version of Gradle.

tonyzzz321 avatar Aug 23 '20 18:08 tonyzzz321

@tonyzzz321 is right. But this should be fixed in master.

I need to fix few more things and i will do a new release

Wizell avatar Aug 23 '20 22:08 Wizell

@JK0304 Can you run "gradle -v" to see what version of Gradle you have? Make sure you have version 5.6.4, not the latest version. I think the new version of Gradle updated something on how to configure the build, and JAVMovieScraper hasn't been updated hence not compatible with new version of Gradle.

Oh man, i use the latest Gradle version, that's why i can't open jar file, it's working now, thank you very much for your help, cheers

JK0304 avatar Aug 24 '20 00:08 JK0304

@Wizell May I suggest committing the Gradle Wrapper to repository. This should remove issues with Gradle version compatibility.

JAVMovieScraper\gradle\wrapper\gradle-wrapper.jar JAVMovieScraper\gradle\wrapper\gradle-wrapper.properties JAVMovieScraper\gradlew JAVMovieScraper\gradlew.bat

zuko7177 avatar Aug 25 '20 06:08 zuko7177

@JK0304 @neko29ssn This is how I successfully built the jar. I don't have any IDE. My JDK version is 11.0.8 and Gradle is at version 5.6.4. I cloned zuko7177's fork (https://github.com/zuko7177/JAVMovieScraper) and then run "gradle shadowjar" to build the jar. The output jar file is located in build/libs/ folder. Hope this helps.

Thank you for the solution! It works!!

rickytor81 avatar Aug 25 '20 07:08 rickytor81

For building a jar from my repo, see https://github.com/DoctorD1501/JAVMovieScraper/issues/335#issuecomment-695662489

Hopefully, @Wizell will approve the PR and build the next official release.

zuko7177 avatar Sep 20 '20 07:09 zuko7177