To answer your question as simply as possible.
No - do not use the battery connection.
Use the USB (USB C power cable) or VBus Pin (Pin 14 on XIAO).
