When he was squeezed out of management in his own company, it is not a coïncidence that he elbowed his way into Jef Raskin's Macintosh project: Raskin was also interested in building information appliances, the difference between the two men was that Raskin was coming to the notion of an information appliance from the HCI perspective, and wanted to focus on simplicity and low cost. The UX he designed was text-centric and used high-speed incremental search as its navigation paradigm.
Jobs was infatuated with what he'd seen at Xerox Parc, and also wanted to build an information appliance, but he wanted it to be powerful and flexible and centered on the WIMP paradigm.[1]
Jobs was the boss, so Raskin left the project and the company. But Jobs never lost his vision that Apple should sell appliances, and people who wanted to "wrench their own devices" should buy PCs.