You don't have to cause misery to others merely because you have chosen to go your own way rather than choosing to chase happiness.
The former of each are karmic, the latter of each are physical.
Happiness and unhappiness are not "chased"; they are earned as a result of one's treatment of others.