Fun! A friend of mine has been working on something similar: https://www.wintermute.org/project/The_Screenless_Office/