Antropus Posted March 17, 2017 Share Posted March 17, 2017 (edited) 4 hours ago, Pacman56 said: Not enabling the "preliminary" option was the problem. All platforms are now showing. None are missing! Not a big deal, but I got an Out of memory error during the Export process. This may have been cause as a result of not exiting LS after the first export and proceeding to export with the "preliminary" option enabled. Keep in mind, I'm just guessing here. I usually exit LS after an export has completed (which I did not do this time). In any case, you were correct as always! Thank you for your great support. Glad it's solved! About the out of memory problem, I changed the way I was exporting the lists. I was loading everything into memory to speed up the process, but then it's just too much to be handled, so instead I decided to use a "type file1.txt >> file2.txt" comspec under the hood, so instead of having to read into memory and then append the contents to a new file, it simply appends it without a big impact into memory. It will be in the new version and in my tests it adds very little time in relation to the old way, but vastly improves memory saving. Still, exporting a full library (65000+ games) will work the first time around, but then will crash the second time if you don't restart LS. I am trying to track where's the leak and trying to flush as many variables as I can find if they are not in use, but certain arrays, the giant ones containing all games information from both mame and Launchbox are resident in memory the whole time, so everything works fast. I might need to rename it to "TurtleSpeed" and parse everything all the time to save memory Edited March 17, 2017 by Antropus 1 Quote Link to comment Share on other sites More sharing options...
Pacman56 Posted March 17, 2017 Share Posted March 17, 2017 24 minutes ago, Antropus said: I might need to rename it to "TurtleSpeed" and parse everything all the time to save memory LOL. I'm not worried about speed. It's still LightSpeed if you compare to someone that would have to do this any other ways. I look forward to the new version! Cheers! Quote Link to comment Share on other sites More sharing options...
wemr97dl Posted March 17, 2017 Share Posted March 17, 2017 Was wondering, i already imported my Mame into launch box with all the platforms, but was wanting to use the All Killer in lightspeed, can I import them again without having issue's?? Quote Link to comment Share on other sites More sharing options...
Antropus Posted March 17, 2017 Share Posted March 17, 2017 47 minutes ago, wemr97dl said: Was wondering, i already imported my Mame into launch box with all the platforms, but was wanting to use the All Killer in lightspeed, can I import them again without having issue's?? I fixed a bunch of things related to that. I would wait for the new release, happening between today and tomorrow! Quote Link to comment Share on other sites More sharing options...
wemr97dl Posted March 17, 2017 Share Posted March 17, 2017 Thanks, Ill check for it tomorrow Quote Link to comment Share on other sites More sharing options...
Antropus Posted March 20, 2017 Share Posted March 20, 2017 (edited) New release: v0.183 Beta10 (3/19/2017)Installer: https://drive.google.com/open?id=0B23vaxsfSk1yS1NCQUJmUmZHaVUZip FIle: https://drive.google.com/open?id=0B23vaxsfSk1yc21FSkhxanNwblk Change log: Paths Tab - There's now a dedicated emulator path for Demul - CHD, ROM and Software List folders can now be separated. Since those changes affect your current ini file, you should get an ERROR on both of those fields. Please just browse for the correct folders (if you are going to use them), then close and re-open Lightspeed to get everything parsed correctly.Options Tab - Under "Export Options" there's now a checkbox called "Use Exclude Lists". This was a suggested feature where you can basically create simple lists, one game ROM name per line, any number of them, with the .txt extension and save those files into the "SupportFiles\Exclude Lists" folder and any game in this "blacklist" will be ignored during the filtering process. This way you are guaranteed not to import certain games ever again.Platform Tab - Expanded the Overrides column to include "Platform from Preset Lists (Arcade)". Those lists come packaged with Lightspeed: All Killer, Demul, FinalBurn Alpha and Golden Era, but you can create your own custom lists and save them in the "SupportFiles\Presets" folder, following this structure: sub-folder name is used for grouping purposes. File names become platform names and their contents are parsed into the new platform. The files should have simple ROM name lists, one per line and should have .txt as an extension. Add your custom lists in there, open Lightspeed and they should be all visible in there. Ctrl+click or Shift+click any number of those lists and they will be all imported. Make sure to click the checkbox to create an override and make sure to check "bypass Filters" if you want to ignore any filters and force the export of those lists. Since Demul uses a different emulator, I strongly encourage you to filter Demul lists by themselves at first, export to Launchbox choosing Demul as the emulator, clear the output list (right click > clear output) then filter the other platforms based on Mame and export them as well, choosing the mame emulator instead.Miscellaneous - This version has some big core changes and it's not fully tested, so please create a Backup before you use it (Lightspeed creates backups for you, but make sure you save your files, to be extra safe) - There is a major change in the way that the games are exported, optimizing memory quite a lot, making possible to export larger lists now. - Big changes in the way the games go from filtered to output, improving speed considerably as it checks for duplicates. - If "Consolidate Clones**" is checked under the Options Tab, when adding games to the output list, Lightspeed will force the import of all related games as well (clones/parents) - Custom Platform names can now be assigned when clicking "2 Output". This is limited to ARCADE games only!!! Software Lists names cannot be changed, as the names conform with Launchbox and changing them would cause Lightspeed not to parse the information from the database. If no name is assigned, the default platform names will be used. - Fixed a bug causing Captain Commando and other games to add software list versions of the game as "Additional Apps". Now Arcade clones and Software List clones are parsed correctly. - Fixed a bug causing "Merge to Library" to corrupt the generated platform files. Among other things. Again, not fully tested because my family life and work are pretty intense these days, but as usual, please test and let me know what breaks. -Kris Edited March 20, 2017 by Antropus 5 Quote Link to comment Share on other sites More sharing options...
quazl Posted March 20, 2017 Share Posted March 20, 2017 I made a backup of my data folder and then deleted the original. I wanted to start from scratch. Here is the error I am getting for each platform. Quote Link to comment Share on other sites More sharing options...
Antropus Posted March 20, 2017 Share Posted March 20, 2017 It looks related to the changes on the way it re-assembles the files at the end. Are you running LS as admin? Can you please zip your Launchbox\data folder and send it to me? Thanks! Quote Link to comment Share on other sites More sharing options...
Antropus Posted March 20, 2017 Share Posted March 20, 2017 You said it's happening with all platforms? Quote Link to comment Share on other sites More sharing options...
mgerety Posted March 20, 2017 Share Posted March 20, 2017 (edited) I've attempted to try out the "platform from Preset Lists (arcade) for the All Killer lists (see attached image), and I get the following when I start Launchbox: Quote It appears that your Launchbox\Data\BeatNHack.xml file is corrupt; LaunchBox cannot continue. Please try restoring a backup of the file from the Backups folder inside of your Launchbox root folder.. Unexpected end of file has occurred. The following elemnts are not closed: Launchbox Line 6905, position1 turns out all of the .xml files in the Platforms dir do not have a closing LaunchBox tag. I'm also getting crap about LaunchBox\Data\Platform.xml, stating: data at the root level is invalid (line 3, postiion 13). Problem is, there is no Platform.xml. There is a Platforms.xml, however when I rename it to Platform.xml, I get the same error and still can't launch Launchbox. Edited March 20, 2017 by mgerety Quote Link to comment Share on other sites More sharing options...
mgerety Posted March 20, 2017 Share Posted March 20, 2017 5 minutes ago, mgerety said: I'm also getting crap about LaunchBox\Data\Platform.xml, stating: data at the root level is invalid (line 3, postiion 13). Problem is, there is no Platform.xml. There is a Platforms.xml, however when I rename it to Platform.xml, I get the same error and still can't launch Launchbox. Scratch that, I'm an idiot, it's talking about \data\platforms\platform.xml, and I introduced the issue into that file. The issue remains however that Beta10 does not add the closing LaunchBox tag to the files in the platforms dir. Quote Link to comment Share on other sites More sharing options...
quazl Posted March 20, 2017 Share Posted March 20, 2017 1 hour ago, Antropus said: You said it's happening with all platforms? Good news! I removed the Zinc.xml and the rest came up. But the fist time I tried a merge and I was getting the same errors as mgerety. Data.zip Quote Link to comment Share on other sites More sharing options...
Antropus Posted March 20, 2017 Share Posted March 20, 2017 Yeah, seems related to the new way I implemented to create those xml files. All those changes I am making are always trying to avoid "out of memory" errors that are a plague!!!! I mean, Lightspeed needs to deal with very large files and it's being a challenge to be able to do it while keeping it fast, as it requires those files to stay resident good part of the time. I'm constantly flushing memory, increasing memory usage per variable etc and it's still hard to make things work correctly. I liked the previous implementation and seems like people were not having those corruption errors anymore, but when I tried to export the full list of 65000+ games it ran into out of memory errors, reason why I tried a different approach. It might be a very small tweak though, so I am not going to scrape the entire thing, but I will need to see why the tag is not closing. Can you guys send me one of those corrupt files? 1 Quote Link to comment Share on other sites More sharing options...
quazl Posted March 20, 2017 Share Posted March 20, 2017 3 minutes ago, Antropus said: Yeah, seems related to the new way I implemented to create those xml files. All those changes I am making are always trying to avoid "out of memory" errors that are a plague!!!! I mean, Lightspeed needs to deal with very large files and it's being a challenge to be able to do it while keeping it fast, as it requires those files to stay resident good part of the time. I'm constantly flushing memory, increasing memory usage per variable etc and it's still hard to make things work correctly. I liked the previous implementation and seems like people were not having those corruption errors anymore, but when I tried to export the full list of 65000+ games it ran into out of memory errors, reason why I tried a different approach. It might be a very small tweak though, so I am not going to scrape the entire thing, but I will need to see why the tag is not closing. Can you guys send me one of those corrupt files? Zinc.xml Quote Link to comment Share on other sites More sharing options...
Antropus Posted March 20, 2017 Share Posted March 20, 2017 (edited) @quazlI opened your zinc.xml file and it's not like the Launchbox tag is not closing, but rather closing in the wrong place! It's closing between the Additional Applications and custom fields sessions instead of the end of the file. Weird. I will definitely take a look and find a safer way to close that tag. Edited March 20, 2017 by Antropus Quote Link to comment Share on other sites More sharing options...
quazl Posted March 20, 2017 Share Posted March 20, 2017 4 minutes ago, Antropus said: @quazlI opened your zinc.xml file and it's not like the Launchbox tag is not closing, but rather closing in the wrong place! It's closing between the Additional Applications and custom fields sessions instead of the end of the file. Weird. I will definitely take a look and find a safer way to close that tag. Thank you for all the hard work. You sir, are a scholar and a gentleman! Quote Link to comment Share on other sites More sharing options...
Antropus Posted March 20, 2017 Share Posted March 20, 2017 You are welcome man and thanks for testing it!! I want to make it stable and I definitely want to squash this memory problem that's driving me nuts. If it wasn't for it, those recent bugs would not be there :-/ Quote Link to comment Share on other sites More sharing options...
quazl Posted March 20, 2017 Share Posted March 20, 2017 (edited) It also seems that there is a graphical issue with one of the pages/tabs. Also clicking "reset" on the Platforms page doesn't reset. Edit: Let me be more specific. It doesn't reset the Arcade tab and specifically the "Bypass Filters" checkbox. It also doesn't deslect any of the built-in filters if they have been selected. Edited March 20, 2017 by quazl Quote Link to comment Share on other sites More sharing options...
Pacman56 Posted March 22, 2017 Share Posted March 22, 2017 @Antropus Just tested beta 10 as well and I'm also getting the problem where the LaunchBox closing tag is inserted right after the opening tag rather than at the end of the file. I'm also sending you the corrupt Arcade.xml file along with the Lightspeed.ini should you wish to try and reproduce. I understand your frustration in trying to deal with these huge files. That would also drive me nuts ! Arcade.7z Lightspeed.ini Quote Link to comment Share on other sites More sharing options...
lones710 Posted March 22, 2017 Share Posted March 22, 2017 (edited) I also got the same bug. One question: The software also introduced this problem to my already existing platforms, like Sony Playstation, Nintendo 64 etc. WHY is Lightspeed even touching these xml s? Edit: I found other bugs: the Custom Values like "Number of buttons" are not assigned as a custom value, they just are in the regular notes of the games. Also consolidating clones does not work, although I told Lightspeed to include clones. Edited March 22, 2017 by lones710 Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.