If the image folder is deleted the cached images would be removed as well so shouldn't be an issue.
@Lahrs I'd suggest setting the media limit to 1 and only grab images you need for your desired experience. Typically a Box, Logo, Background, Screenshot is enough. If you want vids you can grab those but they do take up quite a bit of hard drive space.