Why would you assume it's all or nothing? Will (free or otherwise) implies something like effort and clearly we're not constantly applying effort. Believing in free will doesn't mean believing that everything results from it.
It’s like white swans. If you’ve never seen a bird, you might think that nobody has ever seen a white swan.