If you re-arrange the keyboard into a shape according with human hand/arm ergonomics (of particular relevance for chording, moving or extending thumb keys toward the body; the standard spacebar and modifiers are not especially comfortable), and use a thumb key located in a convenient spot for the layer shift, with the numbers typed using the fingers of the opposite hand, then chorded numbers are just fine: more comfortable and efficient than the standard approach of putting numbers on a separate row.
For cases when many numbers must be typed in sequence, making that layer shift key into an optional mode switch (to effectively turn half the keyboard into a numpad) works pretty well.
Number keys are also indispensable for games where you need to switch items while moving. A finger or two are already going to be busy with the motion keys, adding two more fingers that don't overlap with the motions is going for some octopus keyhandling.
It’s certainly possible to have 2 rows of reasonably reachable keys past the home row (especially if the tops of the further keys are aggressively raised – think 1950s typewriter). Even in the best case those keys are substantially slower and more error prone (and less comfortable) than the home row or next row above, but with decent design can be made nominally acceptable to type on.
But it also works a bit better in practice to put more functions (like numbers and common symbols) on shifted layers, as long as the shift keys are conveniently located. Using pinkies for shift is not the most comfortable choice, especially pinky keys which are a stretch to reach. Modern keyboard layouts are quite terrible for making common computer code symbols accessible.
If you find it uncomfortable to hold down a shift key, consider trying a sequence of key presses instead. That is, let your "shift" just act as a dead key, modifying the immediately following keypress. Try putting your various shift keys on a thumb or forefinger. https://en.wikipedia.org/wiki/Dead_key
I have no particular insight into game inputs, except to note here that a significant proportion of serious computer game players develop severe RSI because their use of keyboard hardware is extreme (and arguably the hardware they use is not very well suited to handling the job safely).
I've never found that to be the case. For me, layers (and modifiers in general) have always been slower and more error prone.
Also, I find the number row on the kinesis quite comfortable. I have yet to find a comparable keyboard in that regard.
This (the “DataStealth”) is a better designed-based-on-anatomy keyboard: http://i.imgur.com/USaQaIG.jpg
Unfortunately never produced commercially.
EDIT: I agree with you about the gaming aspect, though.
That way, instead of having to move one or two fingers, I can move none.