There's a little free-entry one-or-two-room museum on the site: https://www.crystalpalacemuseum.org.uk/ (though ironically it is currently closed due to fire damage; normally open on Sunday afternoons) which has some photographs and various bits of memorabilia relating to the building. If you're planning on wandering down to the site and looking at the dinosaurs, it's worth dropping in here too.