I've been thinking this since the Apple Watch came out, but other than practical limitations (battery life) there's always this problem: have you tried to hold your arm out in front of your face and stare at your watch for a while? It's not the most comfortable position. You might have to add some extra arm/shoulder days in your exercise routine.