duplicate finder

[alpenjodler]

Hi there,

I have imported some roms in launchbox and after I was finished, I realized that I have quite a few duplicates.
Creating an AdditionalApplication entry from the gui is possible but it might take some time.

So I just created a duplicate identifier that automatically creates the xml tags for your platform xml and lists all the files that can be removed (manually) and puts that into a results folder. In theory, you can copy the additional apllication tags into your system.xml and you can remove the files that are listed as duplicates now.

No guarantee it won't mess something up so please backup your platforms directory before you start modifying your xmls.

YOU, YOURSELF. My program does not modify your files, it just lists and makes a guess what you want and puts all that into text files for each system

I think I'll eventually make it more sophisticated and add trying to find wrong database entries.

 

if you call it with no parameters, the program assumes you have your xmls in 

K:\LaunchBox\Data\Platforms\

and this is your priority preference:

        prioList = append(prioList, "North America")

        prioList = append(prioList, "World")

        prioList = append(prioList, "Europe")

        prioList = append(prioList, "Germany")

        prioList = append(prioList, "Japan")

but you can also call it with cli parameters:

first parameter is the filepath with backslash, then you can add parameters with region preferences

 

I included the executable and the source code. Have fun :-D

http://www.filedropper.com/launchboxcleaner

 

Also: it's the first version that creates usable results stored in files for all databases in your system with priority and cli parameters. Expect to see some bugs. I just found one myself: some result files are exactly 4096 bytes and also incomplete...

Edited December 18, 2016 by alpenjodler

[syntax_X]

Pretty sure the new launchbox released yesterday can refresh rom folders dude, should remove any duplicates.

[alpenjodler]

oh! Ohh T.T

Well, I practiced some golang then :-D If you're interested in a golang example how to parse xml files, be sure to check it out :-D

[syntax_X]

Yeah just when you think you have something to add to the community BAM!  These guys have got all bases covered.

[alpenjodler]

hmm, where is it? I only see scan for added/removed roms.

I still have the roms and I want to add them as "additional apllicationos" to what I think of as the main game, I don't want to delete them :-D

[syntax_X]

Im yet to have a propper fiddle with the new options sorry. 

Before this I just delete all roms for a platform and reimport with all fields blank. Unless you damage your xml you should have no duplicates. Stuffed xml imports 0 roms successfully.

Even in your case forcing duplicate imports won't actually double up the rom file, just works

Edited December 18, 2016 by syntax_X

[alpenjodler]

ahh, it's for different regions of games

 

for example if I have a european version and a japanese version and an american version, I want to keep the American version in the list and add the other two as additional applications

[syntax_X]

You can arrange platforms by region the edit the files from there. Heaps easy.

[syntax_X]

I guess it doesn't really show duplicates tho. I see your need for coding now

[alpenjodler]

you can try version 2, It fixes that weird file size bug

http://www.filedropper.com/launchboxcleanerv2

 

ahhh... I have to add one more thing: only use beta if it can't find a non beta one...

Edited December 18, 2016 by alpenjodler

[syntax_X]

Only thing is it will miss titles that are completely different names in different regions ie teenage mutant hero turtles

[alpenjodler]

I got a version 3 that prefers not having beta in the title

http://www.filedropper.com/launchboxcleanerv3

 

and... I have to hope... Oh damn, it can't detect the japanese versions at all -.-

[syntax_X]

You'll get there!

[alpenjodler]

ye. eventually. But now when I tried it, I just created a corrupted database

[syntax_X]

Maybe scratch the updates till youve ironed it out a but more.

Question. With duplicate titles from different regions are the file sizes exactly the same? Could be a good sorting method.

[alpenjodler]

hmm maybe sometimes but I think often it will not be the same

[syntax_X]

Could put all roms from separate regions into separate folders.

Then rename the (J) and (E) to (U) then drag all those roms unto to (U) folder.

Anything that doesn't copy over is a duplicate.

Super dodgy but would kinda work

[frank1982]

5 out of 5 stars for this only program Duplicate Files Deleter. Others are definitely not recommended. Try it to believe it. It deletes everything duplicate. Please use this program and nothing else & I am being serious.

Edited April 20, 2017 by frank1982
in my previous reply the software name was wrongly typed

[alpenjodler]

Nah, don't use it. I gave up on it and also there finally is an actual duplicate finder in Launchbox :-D