The charge current on this board is 1A and is intended for charging larger batteries such as 18650. Charging a 100mAh LiPo with this board may eventually degrade the battery.
I would not use an external charging board and use a 370mAh or larger LiPo connected to the XIAO.