I had no trouble with Catalina but I am having the same problem after I updated to Big Sur. Time Machine gives me a warning that I have lost connection with my external USB SSD HDD. When I turn the drive off and back on it is OK for a while. I have played with the Power setting for sleep, etc. and that makes no difference.