So then when you were installing Visual Studio did you do the "recommended" installation or did you customize?

Even with customization its a bit bloated, but you can totally avoid a SQL Server Express installation.