I can't answer your question but I found this post because I was searching for the same issue. (Late) 2019 MacBook Pro 13" here. Definitely seems related to the caps lock. It will give me the spinning pinwheel sometimes or the whole system freezes up for 2-3 seconds. Sometimes the caps lock button becomes engaged and other times it doesn't. A very odd issue.
zdmcclain
Users receive reputation points by contributing quality content to the forums.
Posts include post and replies published on the forums.
Post authors can mark replies as Accepted to indicate successful solutions.
Apple Developer Forums admins can mark replies as Apple Recommended to indicate an approved solution
From
Moseley