With mplayer and vlc you can manually adjust the cache size.

8mb worked quite well the last years