The second core is not trivial to use, and espressif 's freertos port has real peculiarities in scheduler issues. Spoken as someone who resolved an issue with led buffering interacting with the network system on the esp32.
A base ESP32 chip has dual-core at $8 each on Amazon though. This is still quite expensive in comparison.