Wolfereign Posted September 11, 2014 Author Share Posted September 11, 2014 It would be very nice if there was a tool that deleted games/roms that no longer exists. As it is now if you delete a rom, or even worse alot of roms, from their source folder LaunchBox doesn't automatically detect that they are gone and delete them. At this point there are 2 options: the first is to manually delete every game in launchBox that you deleted from your disk and the second is to delete all the games of the relevant systems where you delete games manually then reimport the system. The problem with option 2 is when you reimport the system you have to redownload all the pictures for each game even though all that data is still in the image folder. For large ROM libraries this can become an extreme problem very quickly. TLDR: A tool that can be either automatically or manually run which deletes games from LaunchBox that no longer exist. Quote Link to comment Share on other sites More sharing options...
SentaiBrad Posted September 12, 2014 Share Posted September 12, 2014 Wolfereign said It would be very nice if there was a tool that deleted games/roms that no longer exists. As it is now if you delete a rom, or even worse alot of roms, from their source folder LaunchBox doesn't automatically detect that they are gone and delete them. At this point there are 2 options: the first is to manually delete every game in launchBox that you deleted from your disk and the second is to delete all the games of the relevant systems where you delete games manually then reimport the system. The problem with option 2 is when you reimport the system you have to redownload all the pictures for each game even though all that data is still in the image folder. For large ROM libraries this can become an extreme problem very quickly. TLDR: A tool that can be either automatically or manually run which deletes games from LaunchBox that no longer exist. This has been planned for a while actually. Good to see it has support though. Quote Link to comment Share on other sites More sharing options...
Neon32 Posted September 12, 2014 Share Posted September 12, 2014 Wolfereign said The problem with option 2 is when you reimport the system you have to redownload all the pictures for each game even though all that data is still in the image folder. For large ROM libraries this can become an extreme problem very quickly. After removing a platform if you ever think that you have to remove extra images from any of the games from any other platfrom and perform the "Clean up Images" task, you will lose all the images from the removed platform and you will have to download everything again, so it would be good if Clean Up images could be done for specific platform or games or any other according to users choice. Quote Link to comment Share on other sites More sharing options...
SentaiBrad Posted September 12, 2014 Share Posted September 12, 2014 Conehead said Wolfereign said The problem with option 2 is when you reimport the system you have to redownload all the pictures for each game even though all that data is still in the image folder. For large ROM libraries this can become an extreme problem very quickly. After removing a platform if you ever think that you have to remove extra images from any of the games from any other platfrom and perform the "Clean up Images" task, you will lose all the images from the removed platform and you will have to download everything again, so it would be good if Clean Up images could be done for specific platform or games or any other according to users choice. That might start to get to the territory that we're afraid to go. How many options is too many? Not to mention, where does what go in what version. Free or Premium. We want to add all the options in the world, but at what point does that just confuse most users or they go untouched; Or it just makes the program inoperable and hard to fix bugs. Quote Link to comment Share on other sites More sharing options...
Wolfereign Posted September 12, 2014 Author Share Posted September 12, 2014 Conehead said Wolfereign said The problem with option 2 is when you reimport the system you have to redownload all the pictures for each game even though all that data is still in the image folder. For large ROM libraries this can become an extreme problem very quickly. After removing a platform if you ever think that you have to remove extra images from any of the games from any other platfrom and perform the "Clean up Images" task, you will lose all the images from the removed platform and you will have to download everything again, so it would be good if Clean Up images could be done for specific platform or games or any other according to users choice. Actually If the Image puller used the TheGamesDB unique ID for each game as the image folder for the games rematching images wouldn't be to difficult. As it is now though the program doesn't do any rematching from what I can see, which is perfectly fine at this point in development. Something like that however shouldn't really take priority at this point though. A game library cleanup task would fix the main cases for the image issue without having to take up the additional dev time to rework the image system that LaunchBox uses. Quote Link to comment Share on other sites More sharing options...
SentaiBrad Posted September 12, 2014 Share Posted September 12, 2014 Wolfereign said Conehead said Wolfereign said The problem with option 2 is when you reimport the system you have to redownload all the pictures for each game even though all that data is still in the image folder. For large ROM libraries this can become an extreme problem very quickly. After removing a platform if you ever think that you have to remove extra images from any of the games from any other platfrom and perform the "Clean up Images" task, you will lose all the images from the removed platform and you will have to download everything again, so it would be good if Clean Up images could be done for specific platform or games or any other according to users choice. Actually If the Image puller used the TheGamesDB unique ID for each game as the image folder for the games rematching images wouldn't be to difficult. As it is now though the program doesn't do any rematching from what I can see, which is perfectly fine at this point in development. Something like that however shouldn't really take priority at this point though. A game library cleanup task would fix the main cases for the image issue without having to take up the additional dev time to rework the image system that LaunchBox uses. Well, we're not sticking solely with TheGamesDB. We're working on Wikipedia and other scrapers, so it honestly wouldn't do much to change that. If we built our own data base with unique codes for each game, that could solve our problem easy, but it would take forever to do something like that. For now, the way we have it works... mostly. There is probably another way to handle images that might be useful, but the problems are generally localized. I had some issues that were not common or didn't happen at all for another user. That is why for now, there is a Clean Up Images option, there will probably be a Rescan option to rescan your entire library to see if there are any info changes or images changes. The problem is trying to create a system that works very well for our uses. That said, we know that some people don't have fast internet, or have bandwidth caps. So I do think on that merit alone, there could be a system devised to keep a centralized folder of images, no matter if the games were just imported. There really isn't anything that can be done about data, but that isn't honestly a big data drain like images can be. Also, that said. Just shy of what just happened to me and I specifically needed to re-import all of my games because a Hard drive changed its letter, there isn't any reason to just pair a persons images folder with the same XML file. Quote Link to comment Share on other sites More sharing options...
Wolfereign Posted September 12, 2014 Author Share Posted September 12, 2014 The image download bottleneck is less Internet speed and more the speed of TheGamesDB on its own. Other scrapers could have big benefits to the speed of Importing rom libraries. For instance multipathing the import so that say if you have 3 scrapers the program imports 3 games at once, 1 game for each scraper. Then at the end you run the games that no data was found for through all the scrapers in an attempt to grab data for it. That or open more then 1 connection to a database to either process the 1 game faster or to process more then 1 game at once. There's a lot of cool stuff like this that can be done to increase scraping speed of importing large libraries. Quote Link to comment Share on other sites More sharing options...
SentaiBrad Posted September 12, 2014 Share Posted September 12, 2014 Opening more connections to a server is generally not a good idea, they don't always like that. Also, using multiple scrapers at once is an idea, but that would be a premium feature as Wikipedia is most likely going to go in the Premium version. Also, the speed of TheGamesDB does vary wildly. They do get a surprising amount of traffic too. I also don't think they have the greatest speeds to begin with anyways. They're sure as hell not using my full 11mb/s download. xD Quote Link to comment Share on other sites More sharing options...
Wolfereign Posted September 12, 2014 Author Share Posted September 12, 2014 I think it would be acceptable to include something along those line in the premium version since it would be a more of an advance feature. Some databases specifically state how many open connections they allow per IP Address. Most databases like that require some sort of login authentication though (TheGamesDB is adding this for any api access, premium or not, btw) so Some sort of credential storage for the scrapper will be needed eventually. Also +1 for premium version to help support development! Quote Link to comment Share on other sites More sharing options...
Jason Carr Posted September 14, 2014 Share Posted September 14, 2014 Good discussion guys, thanks. I'll be looking to add similar features soon. Quote Link to comment Share on other sites More sharing options...
Norfair Posted December 8, 2016 Share Posted December 8, 2016 (edited) This is exactly the tool I would need right now. Does anyone know how to delete all games in LB where the ROM files doesn't exist anymore? Edited December 8, 2016 by Norfair Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.