Yeah, having an on-device DAC was really the killer feature for me. I'm fine using a lightning-to-3.5mm adapter but trying to be clever and putting the DAC in the adapter didn't work out super great for me since they seem to break super easily.
I've just stopped listening to music on my phone.