I'm having the same problem discussed here. gin66/FastAccelStepper#17 (comment)
The author of fastAccelStepper says that "ESP32Encoder author should not take over the PCNT-module interrupt."
I see some earlier issues here mentioned this, but this is causing me a problem with the lastest commit of ESP32Encoder.
Thanks!