There was competition. Bookstacks.com had been in business with a telnet-only interface for more than a year before Amazon.
As noted by others, the shipping cost-to-item-average-cost ratio is precisely why Jeff chose books to start with. But yes, he also looked way out (even if he couldn't see as clearly as some people seem to think he could).