This was a lot of work and you should be really proud.
One suggestion which could simplify things. I noticed this bit of code:
var getNumberColor = function( number )
{
var color = 'black';
if (number === 1)
{
color = 'blue';
}
if (number === 2)
{
color = 'green';
}
// etc
}
You mention using a switch statement, but why not just use an array and look it up by the index?