Technically it's on a Tuesday because back in 1845 people needed a travel day to get to the ballot box and another day to travel back, and you can't travel on the Christian Sabbath, so that only leaves Tuesday - Friday as options.
https://www.bustle.com/articles/192414-why-do-we-vote-on-tue...
Why is it still on a Tuesday? I think your reason is spot on.