ADC Reference Voltage

I’m currently doing some prototyping with a Seeeduino XIAO. I’ve got a voltage divider configured on the 3.3V rail and it seems my readings vary, using different USB 5V power supplies (delta of ~0.15V). I’ve played around with setting some of the references but it still seems to vary. On the same supply, readings are pretty stable. Anyone have similar issues or can point me in the right direction?

Thank you!