I've done it or some variation with German, Latin, Japanese, Norwegian, and Russian.
My method is to listen is small chunks (like a paragraph or so), a bunch of times, and gradually expand the length.
> I can't see how I could pick up the meaning without some reference, unless I was extremely familiar with the material.
You would be surprised at how good you are at it. The human brain is built for picking up a language from scratch by listening, and human languages are similarly built for being acquired in this way.