Hardest thing in my opinion: perseverance. There are going to be ups and downs with starting and running a business. I don't know if anyone really started with the "right idea" -- but as you persevere and keep going ideas evolve and things will hopefully work out in your [business's] favor.