That's fine, and extremely common! I know some accomplished speakers and more than one of them have shaking hands for the first few minutes of a talk. They're just used to it. Some people get over their fear of public speaking, others get over their fear of the fear.