scraper icon indicating copy to clipboard operation
scraper copied to clipboard

Innerworkings

Open truhlikfredy opened this issue 6 years ago • 2 comments

Great tool, but I'm struggling with few things.

How actually some of the inner workings operate? I want to calculate hash without running scraper, but can't the md5,sha and others do not match your results.

Then hash.csv colum 3 is not explained, is that platform? would some table/wiki with explanations possible?

truhlikfredy avatar Jul 16 '18 16:07 truhlikfredy

I mean there is https://github.com/sselph/scraper/wiki/Using-your-own-images and https://github.com/sselph/scraper/issues/104

but can't find table what sysmtem_id is what system

truhlikfredy avatar Jul 16 '18 16:07 truhlikfredy

Sorry I sent this response at lunch via email but github never posted it so will just do it myself. If there is a similar update later, I apologize.

The platform ID was from the following. I don't think I use it for much more than sorting the CSV while working on it. http://legacy.thegamesdb.net/api/GetPlatformsList.php

To calculate the hash without running the scraper, I created https://github.com/sselph/scraper/tree/master/shasum that just loads the info for computing the sha1. It works similar to the standard shasum utility. It could easily be modified to compute other hashes if needed. Depending on the system hashes won't match a standard shasum because the code removes headers and swaps bytes around to get a consistent format to match No-Intro.

sselph avatar Jul 17 '18 00:07 sselph