@AnimusRex, thank you for posting this question, and @C-Beats, thank you for posting this answer! As a new BigBox user, I had the same question and concern.
As a new user, I was also confused by the Hide Auto-Generated Playlists option. I filed the following enhancement request to improve the default behavior:
Enable auto-generated playlists by default in MAME arcade import wizard