This is such a cool comment! Since I've had the device, I've really enjoyed it too, more than even I thought I would.
Yes there are some limited times you might want to turn off recording. I've given this some thought. For now, unplugging is the simple answer.