Yeah, the Framers of the constitution felt the same as you and the 5th amendment used to apply to your belongings as well so a diary you wrote couldn't be used against you.
What's the history around this? And don't these protections only relate to criminal proceedings?
edit: seems the parent is referring to the historical entity of the mere evidence rule which isn't the same as saying that the Framers believed a certain interpretation for the 4/5th amendments.
(4th and 5th overlap here but I generally just cite the 5th as the reason why the 4th applies is because of the 5th)