I just bumped up the sampling rate to 11025Hz and that seems to have helped.