This issue is impacting my apps as well.
The frame duration drops most of the time when a new touch has begun.
After testing on the following devices:
iPhone 8 running iOS 15.6.1
iPhone 11 running iOS 16.1.2
iPhone 14 running iOS 16.2
I noticed it can only be reproduced on the latter.
The application runs smoothly on the first two devices, so I'm assuming it's related to iPhones supporting ProMotion. Still waiting for a fix or a workaround to prevent it from happening.