The issue is not just bank or CC accounts, but your personal data accounts (Email, photos, SMS, calendar, documents, etc.) that give the necessary context to the agent to do useful work for you. That's where the problem lies.