Same issue here. It puzzled me for a couple of months now.
MacBook Pro/i9/32G/Ventura 13.3.1
Initially I thought my dock station is the issue, I moved everything and directly plugin all displays to USB C. But it still happens. CPU usage of kernel_task raise to 700-800% level and fan blows like crazy.
I tried the nvram/smc reset trick and it seems too be working fine now. I will report if it comes back.