Daijishou icon indicating copy to clipboard operation
Daijishou copied to clipboard

Pre-define media folders instead of scraping

Open regiimoep opened this issue 2 years ago • 6 comments

Hi there,

I am thinking about switching over from Pegasus, but I am a little weary of scraping double, as I have already scraped everything once before. Am I able to define a folder where daijishou is already able to fetch the media without scraping? That would save quite a lot of trouble!

regiimoep avatar Sep 26 '22 11:09 regiimoep

Also, it would sove space issue as you could move thumbnails on an sdcard (as I have 2.33 gb worth of game thimbnails now).

If this is to much of an hassle to implement, at least add real time thumbnail downloading.

savethekiddes avatar Sep 26 '22 13:09 savethekiddes

This would be super useful for those of us that already have everything set up, especially with rom hacks and homebrew roms as those almost never get scraped and we have to configure it's boxart manually

Devs21X avatar Oct 04 '22 22:10 Devs21X

Of course. BTW you guys are using skyscrapers? If so what kind of setup and config are you guys using. How are your workflows look like?

TapiocaFox avatar Oct 05 '22 19:10 TapiocaFox

In my case I use Skraper on windows with the generic emulation frontend selection, and I have it configured so it only scrape what I want (boxart, snapshot and title). By default it downloads everything in subfolders inside each one of the roms folder, for example the nes, by default boxarts goes in /roms/nes/media/box3d, snapshots goes in /roms/nes/media/images and titles go in /roms/nes/media/screenshottitle, and the scraped images are named exactly the same as the rom file. With rom hacks as they almost never scrape anything I just add the images manually to their corresponding folder and with the same name as the rom file.

From there I just have to copy the scraped images to their corresponding folders on my different devices.

On my RP2+ currently I only use thumbnails with RetroArch, but I'd love to be able to use them with Daijishō because I already have them, including those for rom hacks and homebrew.

What could be made is to allow us to choose a folder for each platform from where the frontend can take the images as long as they are named the same as the rom file, the subfolder names could be a fixed name defined by you and we'll just need to rename our subfolders to match them with your defined names.

And thanks for creating this frontend, It's the best that I've used and it works perfectly on my RP2+ and on my phone.

Devs21X avatar Oct 05 '22 23:10 Devs21X

In my case I use Skraper on windows with the generic emulation frontend selection, and I have it configured so it only scrape what I want (boxart, snapshot and title). By default it downloads everything in subfolders inside each one of the roms folder, for example the nes, by default boxarts goes in /roms/nes/media/box3d, snapshots goes in /roms/nes/media/images and titles go in /roms/nes/media/screenshottitle, and the scraped images are named exactly the same as the rom file. With rom hacks as they almost never scrape anything I just add the images manually to their corresponding folder and with the same name as the rom file.

From there I just have to copy the scraped images to their corresponding folders on my different devices.

On my RP2+ currently I only use thumbnails with RetroArch, but I'd love to be able to use them with Daijishō because I already have them, including those for rom hacks and homebrew.

What could be made is to allow us to choose a folder for each platform from where the frontend can take the images as long as they are named the same as the rom file, the subfolder names could be a fixed name defined by you and we'll just need to rename our subfolders to match them with your defined names.

And thanks for creating this frontend, It's the best that I've used and it works perfectly on my RP2+ and on my phone.

Thanks. It is very well explained. I will see if I can do in the 1.4 version. I will reproduce the process you’ve described myself after finishing personal stuffs. Much obliged.

TapiocaFox avatar Oct 06 '22 06:10 TapiocaFox

https://github.com/regiimoep/setting-up-pegasus Just to quickly add to this discussion, the Readme I have here also described the workflow I follow, I normally also use Skraper to get my media onto the PC first, then copy the media on my device (like the Odin). The folder structure is also roms/%systemname%/media/%mediatype%

regiimoep avatar Oct 14 '22 09:10 regiimoep

This is a must have feature for me to. Currently i am facing some issue

  1. I have multiple android devices and tons of ROMs since I collect them and i have to re-scrap for every new devices which is time consuming.
  2. I have hack ROMs for language translation which often not scrapped well due to CRC not matching
  3. Daijisho treat every SD card uniquely so swapping larger SD card also need re-scraping

I want to add my experience with other devices/OS and workflow here for additional info as well. There are not only Media/Box art that is supported but also Game Title and description..etc

  1. Ambernic RG353M with JelOS (Emulation Station Frontend) EmulationStation supports a gamelist.xml metadata file which contains a lot of information from Game title, region to media files. Currently from what I can tell it can support these media for screenshot, for Cover,

  2. Ambernic RG353V with ArkOS (Emulation Station Frontend)3. Basically the same as above, since they both use Emulation Station

  3. Miya Mini with Onion OS media only support Cover Art, images has to be .png and name exactly the same as ROM file name and stored in Img folder within the Rom folder.

It also supports custom Game title with a customized gamelist.xml (used by EmulationStation) called miyoogamelist.xml Source: https://github.com/OnionUI/Onion/wiki/Frequently-Asked-Questions-%28FAQ%29

For my workflow of scraping, I uses Skraper which is powered by ScreenScraper.

It can support multiple frontend scraping but also support some manual configuration for emulation station.

I select RecalBox as frontend, select my folder for ROMs then configure for the media.

Using Recal Box will preconfigure to use EmulationStation’s gamelist.xml by default.

Next part is a bit tricky since Skraper does not support auto configure media tag for the gamelist.xml, so go to media configuration and do the following.

  1. delete all media pre configured, the reason is i want to make sure the media link tag like are all properly generated.
  2. Add Image in following type screenshot (which auto map to ), Box2dFront (auto map to ), marquee(auto map to )
  3. Add video which auto map to

After that just hit scrapping and job done.

After scraping is done, i will manually copy the folder for Box2dfront as Img just for Miyoo mini and now my Rom collection have medias for 3 devices and i don’t need to scrap them again and again when i need to change SD card for reason like expanding size of broken SD card.

guschen802 avatar Dec 28 '22 01:12 guschen802

The feature has been added to 1.4.x

TapiocaFox avatar Feb 23 '23 15:02 TapiocaFox