Yes, but according to google they were tapping the "dark fiber" (private lines only carrying google traffic) that were not encrypted between their data centers.
Those lines were for things like data replication so it was a goldmine for the NSA to tap. Those transmissions have since been encrypted.
Not entirely, though Google and subsequently Microsoft, Apple et all have upgraded inter-datacentre connectivity to be encrypted - reducing this attack vector.