Getting lower power consumption on Seeed XIAO nRF52840

So I read that some of the interrupt pins use more power if latched or if Edge vs, level for the interrupt to be generated there’s that and also if you use the pull up or pull down during sleep.

When I encountered a high than expected power consumption, I deactivated most code and started uncommenting and measuring. In system ON sleep and deep sleep without anything else active, the current is 5µA or 3µA respectively. When I set a digital pin to INPUT_PULLUP, this goes up by 31µA. The additional current is independent of the number of INPUT_PULLUP pins (I tried D2, D3 and D4, same as with just D2). Why is that? Is that the current needed by a give or take 100 kOhm resistor at 3.3V and there is no way around that? Meaning I can sleep for 3µA but need another 30µA to be able to wake up again?