I've been building a MIDI device using PlatformIO with ESP-IDF: https://bitbucket.org/doughammond/fourays/src/master/firmwar...

I used this combination because I found USB device support in Arduino framework lacking flexibility.