The Federal Reserve was created after the panic of 1907, because J.P. Morgan (ironic, isn't it) single handedly stopped the panic by buying out the second-most-bankrupt bank (he let the worst one fail). He was the only one in the U.S. who could do so; the Federal Government had no mandate to intervene in economic matters. After the crash, a bunch of congressmen decided it probably wasn't a good idea to have the nation's fiscal health in the hands of one man who was looking out for his own interests above those of the nation, and so they created the Fed to serve as the lender of last resort.
A similar situation existed in Europe, where the Rothschilds functioned as the lenders of last resort to the kings and queens of Europe. Because of their special relationship with the rulers, they made obscene profits through superior access to information and special interest rates. European central banking is largely a reaction against the concentration of so much power in private hands.
A connected elite will always rip off the population at large. There seems to be no way around it; if you cut off one government organization, some robber baron will just grow into the role. Nature abhors a vacuum. It's better to know who the demons are and have some semblance of nominal regulation to keep them honest.
BTW, Andrew Jackson and Thomas Paine were demagogues, much like Ron Paul and Pat Buchanan are today. Their goal is to form a new connected elite by preying off the passions and fears of the population. Never underestimate the power of stupid people in large groups, and all that.