Same issue here on macOS 11.1 and Xcode 12.3. Certain parts of the screen appear yellow in Interface Builder and the simulator.
I was able to work around it by setting File > GPU Selection > Prefer Integrated GPU in the Simulator, then restarting Xcode.