Consider taking your kid to the library often, pretty much as soon as they can walk. The library near us even had a good collection of board books. My kid loves going to the library, playing with some of the toys, looking at the small aquarium, and browsing all the books to pick out the three to take home for the week. He's under 5 and has already checked out about 200 books!

Be sure to pick up at least one for yourself while you're there to set the example during the week!