You likely had something called a 'pair gain' installed - which worked much like DSL, by using a high frequency FM carrier over the audio frequencies to provide a second phone line on the same pair. These things were largely gone by the mid 90's - and were not that common in the first place.