There also would need to be a motivating factor. US doesn't have any reason to want to take over Canada.
Or if the midwest grain fields stop yielding enough during a global drought, the USA might turns its eyes to newly thawing land up north.
It would look more like Germany taking over Austria than Germany invading Poland in any case.