The power supply circuit for the nRF52840 is shown below. Please refer to it.
When USB is connected, up to 4.2V is applied to the battery. The LEDs connected to the same terminals as the battery are also powered, but if this is a concern, why not disconnect the LEDs with a switch?
By the way, what is the required peak current in mA, which may vary depending on the pattern of light emission?