Why push for the more powerful single source processor? If you don’t need it.
I chose the XIAO board pinout because there are multiple vendors… and literally it would be possible to create a TI DSP or STM chipset that fits on the same board. Not tied only to Espressif.