XIAO ESP32C2 ~5 ms pause/freeze every 2 seconds

Again, 1 year later, I’d like to add to this issue.
I’m currently trying to generate step / dir signals using isrs on timers. For the application (motorized microscope table for filming) it is critical that the motion is smooth and consistent.
Everything works well, but every 2 seconds I have a gap of roughly 5 ms, leading to a small stutter in the motor (apparanetly I may not upload the logic analyzer graphs, sorry). I’m using an Esp32 S2.

These regular hick ups across chips, chip models, and even projects leads me to believe that something must be wrong about the esp API. Has anyone of you figured out what that could be?

Any help is greatly appreciated!
Cheers,
lordreas