Hi Knetjster,
Do you use 110mAh batteries? If so, the charging current should be less than 110mA to prevent battery degradation.
Is the charging current on the LiPo charger less than 110mA?
Also the ESP32C3 on-board chargerr has a charge current of 370mA, which is not suitable for charging a 110mAh battery.