The PSP screen was 480x272 pixel, the Xbox 360 was a 720p/1080p machine, assets alone would have been significantly bigger than the PSP's, which is more burden on the NAND and on the CPU for decompression
The Xbox dashboard is slow because of Microsoft's business goals for it, not because the Xbox 360 hardware or software struggles with HD-sized JPEGs or whatever.