10 ms isn't all that much. When games load in assets they'll do various things like malloc huge chunks and you lose a few frames.
If GC only causes occasional (maybe every 2 minutes) loss of a frame or two it should be no problem. If you watch benchmark FPS traces that count every frame delay you'll see that occasional stutters happen in basically every game.
Loss of a single frame just isn't noticeable