your green board is way to thick to get the thru hole to work i am thinking
I say put flux on the power pads of the XIAO… then pre-solder (tin) the contacts… then also flux and tin top of pogo pins… then sandwitch together and apply heat with the iron to the pogo pins and make the connection solid