Not only that, the purpose of refactoring isn't simply for reuse, but also for readability. If you break out chuncks that aren't reusable, but enhance the readability of the code then you've likely improved the code.
Given the choice between reusability and readability I'd say that readability should usually win (although it is a false choice).