Part of the issue with higher fps is that it should be balanced with a shorter frame exposure time, so motion blur matches the frame rate. The rule of thumb is shutter speed should be 2x the fps, so shoot at 30fps, you want the shutter around 1/60s, if you shoot at 60fps, you should use 1/120.
This means anything that adds or remove frames is going to quickly cause the motion to look unnatural or at least different from the original.