Media extremely slow to download, over 10GB of images randomly deleted.

[longshot33]

Hello,

I've been trying to set up launchbox for a while and I keep having issues when it comes to the media download. The box art was showing up fine, but I wanted to add what was missing so I can use other themes. I chose the recommended option to "remove roughly matched duplicates." I also chose the recommended option to "not replace any existing fields or media" so that it could only download what is missing. I was getting download errors for every file and when I searched the forum, I saw that the beta version of Launchbox resolved this issue, so I updated to the beta. When I loaded back into Launchbox, I noticed the box art for most games for just about every system was blank. I checked the hard drive space and over 10GB were missing. I'm not sure how that happened as I didn't choose any option to delete. 

I then tried to download the media again (with the beta fix) and its only downloading 1 file every 5-10 minutes. After many hours it had about 200 files downloaded. I cancelled the process and paid for Emumovies premium assuming that would work. Same issue (but I haven't noticed anything that indicates its even trying from Emumovies). Login test successful for Emu as well. 

I did a traceroute to launchbox and these are the results:

Tracing route to launchbox-app.com [185.132.178.18]
over a maximum of 30 hops:

  1     3 ms     6 ms     4 ms  192.168.1.1
  2    13 ms    13 ms    11 ms  96.120.73.5
  3    11 ms    15 ms    14 ms  24.124.227.169
  4    11 ms    10 ms    11 ms  68.85.35.114
  5    12 ms    14 ms    12 ms  68.85.63.33
  6    13 ms    13 ms    11 ms  162.151.210.41
  7    17 ms    17 ms    17 ms  be-101-ar03.plainfield.nj.panjde.comcast.net [96.108.49.105]
  8    26 ms    18 ms    35 ms  4.68.37.17
  9     *        *        *     Request timed out.
 10    96 ms    96 ms    97 ms  WORLDSTREAM.ear4.Amsterdam1.Level3.net [212.72.41.250]
 11    90 ms    92 ms    90 ms  109.236.95.185
 12    91 ms    91 ms    90 ms  customer.worldstream.nl [185.132.178.18]
 

At this point, I have almost no box art for my many systems and no way to really get it. I have Gigabit internet and disabled firewall and antivirus. 

I hope someone can help. Thank you. 

 

[faeran]

7 minutes ago, longshot33 said:

Hello,

I've been trying to set up launchbox for a while and I keep having issues when it comes to the media download. The box art was showing up fine, but I wanted to add what was missing so I can use other themes. I chose the recommended option to "remove roughly matched duplicates." I also chose the recommended option to "not replace any existing fields or media" so that it could only download what is missing. I was getting download errors for every file and when I searched the forum, I saw that the beta version of Launchbox resolved this issue, so I updated to the beta. When I loaded back into Launchbox, I noticed the box art for most games for just about every system was blank. I checked the hard drive space and over 10GB were missing. I'm not sure how that happened as I didn't choose any option to delete. 

I then tried to download the media again (with the beta fix) and its only downloading 1 file every 5-10 minutes. After many hours it had about 200 files downloaded. I cancelled the process and paid for Emumovies premium assuming that would work. Same issue (but I haven't noticed anything that indicates its even trying from Emumovies). Login test successful for Emu as well. 

I did a traceroute to launchbox and these are the results:

Tracing route to launchbox-app.com [185.132.178.18]
over a maximum of 30 hops:

  1     3 ms     6 ms     4 ms  192.168.1.1
  2    13 ms    13 ms    11 ms  96.120.73.5
  3    11 ms    15 ms    14 ms  24.124.227.169
  4    11 ms    10 ms    11 ms  68.85.35.114
  5    12 ms    14 ms    12 ms  68.85.63.33
  6    13 ms    13 ms    11 ms  162.151.210.41
  7    17 ms    17 ms    17 ms  be-101-ar03.plainfield.nj.panjde.comcast.net [96.108.49.105]
  8    26 ms    18 ms    35 ms  4.68.37.17
  9     *        *        *     Request timed out.
 10    96 ms    96 ms    97 ms  WORLDSTREAM.ear4.Amsterdam1.Level3.net [212.72.41.250]
 11    90 ms    92 ms    90 ms  109.236.95.185
 12    91 ms    91 ms    90 ms  customer.worldstream.nl [185.132.178.18]
 

At this point, I have almost no box art for my many systems and no way to really get it. I have Gigabit internet and disabled firewall and antivirus. 

I hope someone can help. Thank you. 

 

Sorry to hear about your issues. There are definitely more fixes on the way for the 404 timeout issues with emumovies media downloads.

To get you back on track, try a media import only using the LaunchBox DB and uncheck the "remove roughly matched duplicates" option.

[longshot33]

5 hours ago, faeran said:

Sorry to hear about your issues. There are definitely more fixes on the way for the 404 timeout issues with emumovies media downloads.

To get you back on track, try a media import only using the LaunchBox DB and uncheck the "remove roughly matched duplicates" option.

Thank you, it is downloading files now, but it is still very slow and I'm still getting a time out in the trace route. Is there anything that can be done about this? Is says I need to download 166,000 files which will take forever at 1mbpsb

Tracing route to launchbox-app.com [185.132.178.18]
over a maximum of 30 hops:

  1     5 ms     4 ms     3 ms  192.168.1.1
  2    16 ms    17 ms    13 ms  96.120.73.5
  3    14 ms    12 ms    14 ms  24.124.227.169
  4    15 ms    13 ms    13 ms  68.85.35.114
  5    14 ms    14 ms    17 ms  68.85.63.33
  6    17 ms    17 ms    21 ms  162.151.210.41
  7    21 ms    19 ms    19 ms  be-101-ar03.plainfield.nj.panjde.comcast.net [96.108.49.105]
  8    30 ms    23 ms    23 ms  4.68.37.17
  9     *        *        *     Request timed out.
 10   101 ms   100 ms   100 ms  WORLDSTREAM.ear4.Amsterdam1.Level3.net [212.72.41.250]
 11    98 ms    98 ms    96 ms  109.236.95.185
 12    92 ms    94 ms    95 ms  customer.worldstream.nl [185.132.178.18]

[longshot33]

Ok, so I have a new issue and a possible resolution, but I need confirmation that what I want to do will work. 

As my original post indicates, media was deleted from the Launchbox media folders. It's currently downloading an entire new set of media for everything. The problem is I'm running out of drive space. The reason is because I have a backup of some of the media on this drive but the folder structure is completely different and it's also not a complete set of all required media. I would like to use some of that media and move it to the launchbox folders (to both create drive space and speed the process up). 

I looked at one of the video files that launchbox has downloaded today and the video itself is identical in size to the one I had in my obsolete backup folder. It has a different name though.. the one in Launchbox is: "Star Fox 64 3D.mp4" and the old one is titled: "Star Fox 64 3D (USA).mp4" 

I can't rename each and every video to remove the "USA" part so would Launchbox be able to use the video still if I just leave it as it is and copy the videos (including the USA) to the Launchbox video folders? If I do that and then scan again will it try to also grab the non-USA titled one as well and create duplicates? Remember I don't have "Delete roughly matched duplicates" checked as suggested above by Farean.

[Rob_G]

 I find that trying to manage game media is a pain with Launchbox.   You can't easily work (in Launchbox) with just the games missing media.  At least I figured out a trick to make a temporary playlist for games with an empty metadata entry so I can fix ones that have wrong names.  If I could do the same for games missing clear logos, videos, etc then it would be easier to manage these.

 

Rob

[C-Beats]

3 hours ago, Rob_G said:

 I find that trying to manage game media is a pain with Launchbox.   You can't easily work (in Launchbox) with just the games missing media.  At least I figured out a trick to make a temporary playlist for games with an empty metadata entry so I can fix ones that have wrong names.  If I could do the same for games missing clear logos, videos, etc then it would be easier to manage these.

 

Rob

Could just set your library filter (by default on the left the drop down that reads "Platforms") to "Games Missing Media" then pick the image group you are trying to complete.

[faeran]

On 7/10/2021 at 3:03 PM, longshot33 said:

Ok, so I have a new issue and a possible resolution, but I need confirmation that what I want to do will work. 

As my original post indicates, media was deleted from the Launchbox media folders. It's currently downloading an entire new set of media for everything. The problem is I'm running out of drive space. The reason is because I have a backup of some of the media on this drive but the folder structure is completely different and it's also not a complete set of all required media. I would like to use some of that media and move it to the launchbox folders (to both create drive space and speed the process up). 

I looked at one of the video files that launchbox has downloaded today and the video itself is identical in size to the one I had in my obsolete backup folder. It has a different name though.. the one in Launchbox is: "Star Fox 64 3D.mp4" and the old one is titled: "Star Fox 64 3D (USA).mp4" 

I can't rename each and every video to remove the "USA" part so would Launchbox be able to use the video still if I just leave it as it is and copy the videos (including the USA) to the Launchbox video folders? If I do that and then scan again will it try to also grab the non-USA titled one as well and create duplicates? Remember I don't have "Delete roughly matched duplicates" checked as suggested above by Farean.

If the name of your images or videos are the same as the name of your ROM, LaunchBox will accept it, if placed in the appropriate folders.

[Rob_G]

15 hours ago, C-Beats said:

Could just set your library filter (by default on the left the drop down that reads "Platforms") to "Games Missing Media" then pick the image group you are trying to complete.

 At first I didn't see that because it doesn't show up until after you select 'refresh all missing media'.  Now I have that option.  Thanks!

 

Rob

Edited July 13, 2021 by Rob_G