Cabirus Posted August 13, 2015 Author Share Posted August 13, 2015 When importing my Amiga games collection (WHDLoad), I noticed that not a single game is recognized and scraped from TheGamesDB. I think the reason is that all the games have cryptic games like AlienBreedTowerAssault11_v1.2_AGA_2331.zip, which can't be interpreted by TheGamesDB. My feature suggestion: Adding the "Online Amiga Games Database" to the scrapers. This big database is specifically tailored for Amiga, including game descriptions, screenshots and images. Frode, the guy behind the database and the FS-UAE emulator, is an nice guy. I am confident he would allow scraping the database if asked nicely. 1 Quote Link to comment Share on other sites More sharing options...
Jason Carr Posted August 13, 2015 Share Posted August 13, 2015 Hi @Cabirus, thanks for this. You're correct in your assumptions. I'll reach out to Frode soon. :) Quote Link to comment Share on other sites More sharing options...
wasili Posted October 14, 2015 Share Posted October 14, 2015 It realy annoyed me that there is no way to import any data for amiga games in Launchbox, so I figured out a way to rename all my whdload games. This way, launchbox can at least get some stuff. Maybe other people are looking for a way to do this, so I'll share it here... How to: Help Launchbox scrap meta data for whdload Amiga games by renaming them with Power Shell + RegEx It won't work for all games, but for the vast majority, so renaming the remaining ones by hand won't be such a big deal. Attention: The following commands aim at games stored as .zip files. For .lha format exchange .zip with .lha in the commands. Use seperate folders for both formats when using this method or the extensions will get messed up! 1. Make a backup of the directory containing your whdload games. You don't want to download them all over in case you made changes you can't reverse! 2. Open Power Shell and go to the directory containing your whdload games. 3. Apply the following commands. The -whatif flag at the end of each command means the shell will only simulate the command and show you what would happen if you execute it. To actually perform it you have to remove the flag from the end of the command. You can paste thoose from your clip board to the shell by clicking the right mouse button. I'm not a regex pro, so i split up the task in several commands. Apply once: Remove .zip extension: ls | Rename-Item -newname {$_.name -replace "(.*).zip", '$1' }-whatif Apply several times: Remove additional information seperated by underscores: ls | Rename-Item -newname {$_.name -replace "(.*)_.*", '$1' }-whatif You can repeat a command by pressing the up-arrow-key. If you get warnings during this step, you possibly have several versions of a game stored. You should rename theese games by hand or just ignore this for now if you don't really need theese versions or if you are just keeping them in case another version is not working (as I do). Apply several times: Split game name into single words: ls | Rename-Item -newname {$_.name -creplace "([A-Z].*?)(\S)([A-Z]|&|\d{1}\S*)", '$1$2 $3' }-whatif Apply once: Reattach .zip extension: ls | Rename-Item -newname {$_.name + '.zip' }-whatif Done! 1 Quote Link to comment Share on other sites More sharing options...
Cabirus Posted October 15, 2015 Author Share Posted October 15, 2015 Thanks, wasili! I'll try this later. I'm afraid renaming the games will make it impossible to run them with WinUAELoader or FS-UAE though, have you tried this already? I'm still hoping for an integration of the OAGD though, as it is far more complete than GamesDB regarding Amiga games. Have you reached out to Frode, Jason? Not trying to push you or anything! Quote Link to comment Share on other sites More sharing options...
Jason Carr Posted October 15, 2015 Share Posted October 15, 2015 Hi @Cabirus, iirc I did reach out to him but didn't hear back. I'll have to reach out again soon. Quote Link to comment Share on other sites More sharing options...
wasili Posted October 15, 2015 Share Posted October 15, 2015 @Cabirus: At least with fs-uae, the games will still work. At least the ones I tested (both .zip and .lha archives) still did. I read that Frode wants to add a feature that automatically gets the best configuration from their database when starting whdload games, maybe this won't work then. But there's still the .slave file inside the archive which should be enough to identify a whdload game (I think)... Quote Link to comment Share on other sites More sharing options...
Cabirus Posted January 24, 2016 Author Share Posted January 24, 2016 jason carr: Still no reply from frode I guess? Maybe he doesn't want his database scraped by other software. Quote Link to comment Share on other sites More sharing options...
Jason Carr Posted January 24, 2016 Share Posted January 24, 2016 Yeah, still no response. Feel free to keep reaching out; let me know if you ever get a response back or find a way in. :) Quote Link to comment Share on other sites More sharing options...
SentaiBrad Posted January 24, 2016 Share Posted January 24, 2016 Moby Games has a decent cover of some older PC's, including Amiga, so even if nothing ever comes of this I'm sure we can get decent cover from Moby Games. Quote Link to comment Share on other sites More sharing options...
locvez Posted January 27, 2016 Share Posted January 27, 2016 I just wanted to add to this that I downloaded the entire whdload install collection from here (unfortunately going to the site the old fashioned way seems broken at present, but the files are still there) and they scrape ok-ish using emumovies (you get images and video but no metadata i'm afraid) Using the new beta release worked for me, the current official release caused some sort of weird issue where it would crash the import but the beta works fine. Quote Link to comment Share on other sites More sharing options...
CriticalCid Posted February 2, 2016 Share Posted February 2, 2016 I think Mobygames would be enough as scraper because they just reached their goal to complete their Amiga Database two weeks ago. I think the bigger problem is to get the scraper to work with the WHDload naming format. The easiest way in my opinion would be to use the same mechanic as MAME. I don’t know if there's an official database with a WHDload names to correct game titles conversion like MAME has, but the HyperSpin XML would work really fine in this case. The XML has all games with their WHDload file names included but also features the real game title as description. Here’s the link to the current HyperSpin Amiga XML: http://www.hyperspin-fe.com/files/file/8070-commodore-amiga-hyperbase-database-official/ Quote Link to comment Share on other sites More sharing options...
Jason Carr Posted February 2, 2016 Share Posted February 2, 2016 Hi @CriticalCid, I agree that the Hyperspin XML would definitely be a good resource. My only gripe that I've noticed about their approach is that it seems to often be missing various regions, extra versions, etc., which I don't personally care about (because it tends to have the best versions), but I know we're gonna get people complaining about that eventually if we stick closely to the Hyperspin data. I'd really like to come up with our own, similar to the Hyperspin data with all the missing data added. Quote Link to comment Share on other sites More sharing options...
CriticalCid Posted February 2, 2016 Share Posted February 2, 2016 In this case the regions wouldn’t be a problem because the Amiga XML is specifically designed for the WHDload set only. But I didn’t mean to scrap the metadata of the XML anyway. It should just take the WHDload names from it and use them for scraping Mobygames, TGDB, etc. Or a mix of both just like the scraper for MAME. Like mentioned in this thread before, the specific naming format of the WHDload set makes it really hard to get good or even any metadata right now. Quote Link to comment Share on other sites More sharing options...
Jason Carr Posted February 2, 2016 Share Posted February 2, 2016 Sure, makes sense. Sounds like a good solution for Amiga then. Quote Link to comment Share on other sites More sharing options...
polygonslayer Posted March 1, 2016 Share Posted March 1, 2016 Hey, I'm about to look into importing Amiga games and I remembered looking at this thread a while ago. Not sure, but has there been a good solution for scraping them based of the whd file names? Cheers :) Quote Link to comment Share on other sites More sharing options...
CriticalCid Posted March 1, 2016 Share Posted March 1, 2016 Not without renaming everything. For now we have to wait for Jason until he integrates my suggestion or another solution. Quote Link to comment Share on other sites More sharing options...
francis Posted June 15, 2016 Share Posted June 15, 2016 This would be great. Quote Link to comment Share on other sites More sharing options...
wasili Posted June 20, 2016 Share Posted June 20, 2016 since people keep asking about the whdload scraping thing I created a bitbucket issue and linked to it in this thread: https://www.launchbox-app.com/forum/contributions/missing-database-amiga-whdload Quote Link to comment Share on other sites More sharing options...
Cabirus Posted July 31, 2016 Author Share Posted July 31, 2016 Just curious: Any progress on the WHDLoad issue? Big Box is getting better and better and I'm dying to add my Amiga collection... Quote Link to comment Share on other sites More sharing options...
Styphelus Posted August 3, 2016 Share Posted August 3, 2016 Any solution for this yet? I have a few systems that I can't seem able to find a good way to import, this one being one of them. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.