Unfortunately, that's nuclear's only strength with something so small. Chemical batteries are much more cost effective, lighter and much more powerful(power-wise) than RTG's.
Also, for most things, including quadcopters, use of radioactive-material, not only is a risk, is a major waste. Most technology, in these days, appear to last 5 years(if you're lucky). Having batteries, that outlasts what it powers by magnitudes of time, is just not sane.
I use the combined example of quadcopters and bees because, perceptually, they appear to be on the same physical level (as opposed to a rock versus a molecule, for instance), but they require very different design decisions as to how they are powered. Chemical processes used for a quadcopter won't easily translate to a bee (unless we are using something exotic, such as ATP manipulated by nanotech), whereas nuclear processes could easily transition between the scales occupied by the quadcopter and the bee.
NOTE TO SELF: Write a children's technology coloring book called "The Quadcopter and the Bee", and after some initial success, turn it into a series of eyewatering, yet thought-inducing, books and movies, thus making lots of money, which would in turn be used for your "Nuclear Batteries Are Us" startup.
The main problem with nuclear is that it doesn't give enough energy, when you want something so small.
I believe the best bet to power both the quadcopter and the bee are microwaves, in another words, wireless energy. There has been some concepts(some of them were even materialized), of RC toys, being powered like that. It will limit their range, but it will gain so much.
But who I am to predict the future? Maybe nuclear will be the way to go :P