I think there is a categorization error here. Deep architectures are possible for many classes of learning algorithms: deep Bayesian nets, restricted Boltzman machines, graphical models, multilayer perceptrons, etc. Convolutional neural nets and LTSM are just two other types, and they exploit spatial and temporal structure explicitly.