This happened to me with Public Beta 1 (build 20A5343j, equivalent to Beta 4) after upgrading. I had the Safari 14 for macOS Catalina beta 4 installed on Catalina.
Apparently there's a bug in the macOS installer that leaves old Safari frameworks in /Library/Apple/System/Library/StagedFrameworks/Safari. This folder is on the Data volume, but cannot be modified outside of Recovery or without disabling SIP.
Just delete /Library/Apple/System/Library/StagedFrameworks/Safari, so that /Library/Apple/System/Library/StagedFrameworks is empty. You may have to boot to Recovery and mount the Data volume there to do this.