On the whole though, it seems weird to eschew software USB but then go ahead with software serial. I would definitely have just done this as FTDI -> SPI. Or thrown away the AVR, and gone with a some dirty-cheap 32-bit ARM chip that has the needed peripherals built right in. Maybe an STM32F04, which is $3.64 at quantity 1:
http://www.digikey.ca/product-detail/en/STM32F042K6T6/497-14...
That's a 32-pin LQFP package, which is straightforward to hand-solder for an intermediate.