That's actually how it should be. I think you should aim for 4 to 5 breaths per minute, I don't remember the exact number.
The technique is described by Kelly McGonigal in "The Willpower Instict" as being the only scientifically proven "quick hack" to make your brain relax and focus.