To simplify the other more detailed response, It's just Uranium at that point. Even highly enriched Uranium isn't that radioactive by itself, it's once you start operating the reactor that it starts generating highly radioactive waste.
The new fuel rods going into it are totally safe from a radioactivity perspective. Here's a picture of a man holding a fuel rod bundle with nothing more than gloves on. http://nuclearstreet.com/images/img/dw037.jpg