Same for me, but with my primary number on Google voice. Google dropped the ball here with an option to compete with iMessage, whether with Voice or Hangouts/Gchat