As the AD85050 has a stereo I2S input there's a possibility for the actual crossover to be either done on the amp chip itself (with the same signal driving both channels) or done on the Amlogic SOC. The latter would be ugly as you would need another DSP chip on your board to do the crossover functionality, or perhaps you could program the AD85050 via I2C to add the appropiate low and high pass filters.
A two channel A/D converter would work on the front end, as you could drive both channels with a single analog input to get a stereo I2S out with duplicate channels to drive the amp. A USB input would be much messier if you want true stereo using two speakers unless you plan on doing routing on the software side. With SPDIF you probably could get away with splitting the signal and using a SPDIF to I2S converter chip in each speaker, but you would still need some way to separate out the left and right channels. The AD85050 has mixing functionality via I2C which may help with that.
And of course, all this might be more work than desigining an amp in the first place, and it really depends if you want to explore the analog or digital side of things.