Your latent passions are very likely non-specific, an affinity for particular facets of your lifestyle that resonate with you; not some specific regiment of what your business (as employee or otherwise) actually does.

So no, it doesn't predestine you down a particular career path where any deviation will leave you miserable. Your passions can apply very broadly.