Well I found one thing wrong in my code (there’s probably more). I called the BLE.scan() function within the main loop.
This means every time the scan function gets called, even when it is already scanning.
I moved it to the init loop, and now I get more devices. Still not the device I’m looking for tho.
Fun fact: the XIAO itself sais: advertising: legacy in nrfconnect