I’ve been having a similar if not the same issue.
The Arduino editor loses connection to the port. I’d have to unplug the XIAO then plug it in again for it to be recognized. After doing this on and off for a few days the XIAO can no longer be recognized through another XIAO still works fine.
The bad XIAO still comes to life when I plug it in, but I can no longer upload programs to it.
I’m going to test it to see if I can upload a program through the SPI pins.