I'm having the exact same problem with no peripherals - MacBook Pro (16-inch 2019), 2.3 processor.
I'm having the exact same problem as described above - multiple crashes a day, occurring after the latest upgrade to 11.3.1. The crashes occur at random times - everywhere from restarting Docker to visiting target.com or even waking up my machine from sleep. I rarely have any notice, but during a handful of times, I lose Internet/VPN connection for a second or two before fully crashing. I've seen so many different error messages that I have a separate text file with a number of them:
"Possible memory corruption: pmap_pv_remove(0xffffff8745b18b40,0x7f805f265000,0x1000, 0x10000001000000, 0xffffffa151a33334, 0xffffffa151a332f8): null pv_list, priors: 2"@/AppleInternal/BuildRoot/Library/Caches/com.apple.xbs/Sources/xnu/xnu-7195.81.3/osfmk/i386/pmap_internal.h:903
Kernel trap at 0xffffff80037ba3df, type 14=page fault, registers:
"Bad list head 0xffffffa1b62ee160 first-prev != head @2320"@/System/Volumes/Data/SWE/macOS/BuildRoots/2288acc43c/Library/Caches/com.apple.xbs/Sources/xnu/xnu-7195.101.2/bsd/vfs/vfs_cache.c:2320
[data.kalloc.4096]: element modified after free (off:1184, val:0x0000000008000000, sz:4096, ptr:0xffffff93cb553000, prot:zero)
I've run various diagnostics tools, booted in Safe Mode, reset NVRAM, no luck for anything. Earlier this week, I made it 28 hours without a crash, but now I'm back to multiple crashes a day.