I have the exact same problem. I returned it to a authorised service provider with an exact description. They found nothing. After the return it worked for about a month. Maybe it has something to to with the usage of the the device (MBP, 16 Inch, 2019 in my case). The issue is here for about a year now. If they don't do anything about it, it's going to be very hard to recommend these devices to customers and others asking for help in their decision of buying a new notebook, especially when it also happens to M1-Devices.