Well there is a whole bunch of things that sort of work together here that could cause the issue depending on your hardware, more specifically your CPU speed and core you are using.
Frame Delay ties to V-Sync and input lag, you want to have it has high as you can before sound issues pop up then you just dial it back one step. The higher you set it the less input lag you will have but more demand gets put on your CPU and in turn causes issues.
Shaders can increase the load on your hardware and depending on the shader being used some will have a larger effect. the easymode shader is not a terribly heavy shader at all. If you want to try without a shader you can but that will be up to you. Or you could try another shader like hyllian or crt-pi which are very light weight shaders and see if those have a look you like and have any difference in performance for you.