So much screen-staring time can be saved with just pen and paper. We need to learn to do it more often.
I found a solution though: Lowe's sells a 4'x8' sheet of whiteboard for fifteen bucks, now I have my whiteboard covered wall in my home office so I'm happy again.
Colored pencils are usually very difficult to erase. I've found whiteboards are great for sharing. Get a set of small tip dry erase pens, much better than the standard ones, and helps both writing small and gorilla arm (though I've never really had issues with the latter).
https://www.amazon.com/Krylon-K03943000-Erase-Brush-Quart/dp...
And if you're sharing that whiteboard (in any form) with remote colleagues, try sharetheboard.com. Our team put it together precisely because we didn't want to say goodbye to the ol' board.