Yeah, it's kinda annoying that the app keeps creating folders that might never have any file in it. I mean, there's no need for the Nintendo Switch or any other handheld to have an "Arcade Cabinet" folder.
I'm my case I see it as a lost battle, I just let it be, I see the folders as part of the software itself, I don't bother deleting them anymore.