Not even smaller operating units, it just sounds like things will be organized according to product rather than function. Other HN articles recently have mentioned how Google has a bunch of centralized organizations that report all the way to the top and are not responsible to any product group (Launch, Site Reliability, UX, Product Management, etc).
What's different about Android is not that Andy Rubin has an engineering background; many of Google's senior managers do, even in the big functional orgs. What's different is that Android is a product unit which largely does not depend on these external functional teams and has all its resources built in.