CommunityScrapers icon indicating copy to clipboard operation
CommunityScrapers copied to clipboard

scraping clip information from dvd sites

Open xiosensei opened this issue 4 years ago • 7 comments

proposing to add a way to scrape specific scenes from a movie page.

example: https://www.hotmovies.com/video/320614/Babysitting-The-Baumgartners/

I would like to scrape clip 10 to get the actors, the very specific tags that this site provides and the scene number!

one way to do it is by providing the scene id as a hashtag after the link: https://www.hotmovies.com/video/320614/Babysitting-The-Baumgartners/#2193787

but obviously this does not get picked up by the scraper and i am guessing development is needed before that part can be picked up.

another way is to maybe providing the clip number as a hashtag in the link: https://www.hotmovies.com/video/320614/Babysitting-The-Baumgartners/#10 -- to indicate I want to scrape scene 10 info.

xiosensei avatar Nov 09 '21 15:11 xiosensei

This is a very specific need and site specific i think.While not possible by json or xpath scrapers you could make a script (python?) scraper to get what you want

bnkai avatar Nov 14 '21 14:11 bnkai

@xiosensei This site is very interesting. I am trying to find a way to get info only for clip 10. If I manage to do that, I will let you know.

philpw99 avatar Nov 14 '21 23:11 philpw99

Seems it can only be done by using python script and ask a clip number on the fly. Like a window below: test

Will this dialog be ok when scraping?

philpw99 avatar Nov 15 '21 03:11 philpw99

I chatted in Discord about this. Seems this GUI prompt is not a good idea. Now I am wondering how to get the clip no from the user. One way is to get the number by adding "?clip=10" in the end of the URL. But then the user might not know about it, and wonder why the scraper doesn't work. So I am stuck here. Maybe you will share some info about the name format of your dvd file? Is it like "hotmovies xxx clip xx.mp4" or some other format?

philpw99 avatar Nov 17 '21 01:11 philpw99

Great ! Now the one who requested this has no more interest in this. Why should I make this scraper at all ?

philpw99 avatar Nov 19 '21 22:11 philpw99

@philpw99 I am here.. just gave up on this when @bnkai replied lol.

xiosensei avatar Dec 28 '21 04:12 xiosensei

I have made a PR for a scraper for AdultFilmIndex, the site has metadata of thousands of adult DVDs https://github.com/stashapp/CommunityScrapers/pull/892

themese8 avatar Feb 03 '22 14:02 themese8