Adding a battery is impractical in our use case and we don’t use USB power. Nonetheless I can now confirm that it wasn’t related to fluctuations in the 5V supply, but to the Vin rail generated by the battery charger IC. I’ve documented these findings here. I’ve since bridged out the battery charger IC and the problem has never returned.