Hi there,
YES… The diode is only there to protect the device if current try’s to shunt through if you connect both sources Strongest will win and Xiao will hurt the battery charger circuits.
There is a diagram and a pretty complete explanation with current paths for each Scenario on here somewhere. Search the battery threads for Xiao 
HTH
GL 
PJ 