As one who read the poem and was caught away by the sense of adventure it instilled and dreams of treasure, I read up on the chase. Turns out, the chest was not buried. If you were in the right spot from the poem, you could see it was just placed on the ground.