No you are not being irrational. Customs and Border Protection have been known to detain and force US citizens to reveal their passwords:

https://arstechnica.com/tech-policy/2017/02/what-could-happe...

The chance of this happening to you is very small, but not zero.