Hello, Same problem with my Macbook pro 2019 (with AMD 5300).
Updated on Big sur 11.6.
Tried with different adapters. If I plug/unplug one of them or both -> Kernel Panic almost each time.
After two calls with Apple care team, they told me to "reinstall macOs Big Sur". Without any changes...
So, I just lost a day of work to try to avoid the case. With no solution...