It looks like it takes 1500 tons of concrete per mile of highway, and a ton of concrete produces 900 kg of CO2, which I will estimate to be 1 ton of CO2. So, 1500 tons of CO2 / mile of highway. It is said to last 60 years, so 25 tons CO2 / year.
It appears to take somewhere between 115 - 215 tons of steel per mile of highway track, but you're going to want double track if you're comparing to highways, so 200 - 400 tons of steel. Steel produces somewhere between 1 - 3 tons of CO2 per ton of steel depending on how it is produced. So say 300 tons of steel at 2 tons CO2 / 1 ton of steel. So 600 tons of CO2 per mile of railroad track. Track lasts from 2 - 40 years, so if we say 20 years on average, we get 30 tons / year.
Maybe highways don't last 60 years, or track lasts longer than 20. Also, if you are thinking of high speed passenger rail, it uses a lot of concrete so that it can be on an elevated track. But it looks like concrete highways and railroads are comparable as fair as CO2 from construction. Certainly rail isn't so "vastly" better that we need to be concerned about phalanxes of FUD.
Now, operating costs in terms of CO2 probably favor railroads pretty heavily, at least for freight. Since passenger rails is a lot less dense in terms of cargo, the story for passenger rail might be different.
(These figures are sourced from asking DDG "co2 per ton concrete", etc)