R18.com scrape doesn't work anymore

[capt1234]

Describe the bug All the other sites are working, but scraping from r18.com does not work anymore. On the date 16th September 2020 it was working, but today, 18th September 2020 it is not working anymore.

Give an example You can try any JAV-Movie, it doesn't work.

[Borisbee1]

R18 refuses connections unless you provide a user agent now

[capt1234]

Oh, damn! The translations from R18 are well translated... the translations from javlibrary.com are bad, seem to be auto-translated... :-(

[zuko7177]

R18 scraping is working for me without UserAgent.
Nonetheless, I've updated my PR to add UserAgent to R18. https://github.com/DoctorD1501/JAVMovieScraper/pull/332/commits/77f394fffb5ff23563a454dec02a2c91777918e9

[Json188]

Ya, same here DMM\FANZA scrape also not working

[NewMember12345]

@zuko7177 you mind doing a build on your github fork so we peasants who don't know how to compile to get a jar?

[zuko7177]

Building a jar should be easy as I added the gradle wrapper.

1. Install JDK 11
2. Clone my fork to your local drive.
3. On windows, run the gradle wrapper: gradlew.bat shadowJar
4. The jar is in \JAVMovieScraper\build\libs\

I've attached the jar if anyone still needs it. JAVMovieScraper-all.zip

I've switched to using https://github.com/jvlflame/Javinizer. It's been good and really fast. The repo owner does a great job. I'd encourage anyone to check it out.

My process is now

1. Use Javinizer to do initial scrapes.
2. Afterwards, use JAVMovieScraper to scroll through the scrapes. Make manual changes if needed.
3. Enjoy.

[NewMember12345]

@zuko7177 Thank you very much for the included gradle wrapper. It makes it so simple! I just tried Javinizer - The work flow is very different for my personal use. I have my mp4 sorted into its own folders with diff mp4 info like abc-123.1080p.mp4 or abc-123.uncenosred.mp4. Javinizer pretty much strips all my mp4's filename info into plain ABC-123 and it sorts into its own folder with the title names in the folder name. I looked into the setting files there and didn't seem like I can change this behavior.

[zuko7177]

@zuko7177 Thank you very much for the included gradle wrapper. It makes it so simple! I just tried Javinizer - The work flow is very different for my personal use. I have my mp4 sorted into its own folders with diff mp4 info like abc-123.1080p.mp4 or abc-123.uncenosred.mp4. Javinizer pretty much strips all my mp4's filename info into plain ABC-123 and it sorts into its own folder with the title names in the folder name. I looked into the setting files there and didn't seem like I can change this behavior.

I would give Javinizer 2.0 documentation another look. There is a nice settings file. I see a setting to "not rename files". sort.renamefile : Specifies to rename the movie file after being sorted. values is 0 or 1. And there are various settings for folder and file handling too.
Perhaps post a question if it supports what you want. Who knows... the repo owner may implement it. jvlflame has been receptive to reasonable requests.

Anyways, hope my updates to JAVMovieScraper helps you. I probably won't update it much further since I no longer use it as much.

[NewMember12345]

I'll give it a try again with that setting off. Thanks for helping us zuko7177.

[berrysoda]

Building a jar should be easy as I added the gradle wrapper.

1. Install JDK 11

2. Clone my fork to your local drive.

3. On windows, run the gradle wrapper:  gradlew.bat shadowJar

4. The jar is in \JAVMovieScraper\build\libs\

I've attached the jar if anyone still needs it. JAVMovieScraper-all.zip

Any slightly more level 0 instructions? I get JDK installed, download the zip of your fork, unzip it, win+r then pasting "gradlew.bat shadowJar" doesn't find it. running the "gradelw.bat" in the unzip of your fork does something when ran, but it closes the second it finishes, so I don't know what it did. Looked around but didn't find any signs of the jar of your version having been created.

[NewMember12345]

Building a jar should be easy as I added the gradle wrapper.

1. Install JDK 11

2. Clone my fork to your local drive.

3. On windows, run the gradle wrapper:  gradlew.bat shadowJar

4. The jar is in \JAVMovieScraper\build\libs\

I've attached the jar if anyone still needs it. JAVMovieScraper-all.zip

Any slightly more level 0 instructions? I get JDK installed, download the zip of your fork, unzip it, win+r then pasting "gradlew.bat shadowJar" doesn't find it. running the "gradelw.bat" in the unzip of your fork does something when ran, but it closes the second it finishes, so I don't know what it did. Looked around but didn't find any signs of the jar of your version having been created.

I had it working briefly but with the constant changes, this github project sort of have been abandoned. I've also transitioned to using Javinzer by Jvflame. Works very well. I'm using the command line interface because the GUI never worked for me. It scrapes faster than javmoviescraper and now has added MGStage support!

https://github.com/jvlflame/Javinizer