For what it's worth, I had the same problem. I've been frustrated by this for days since I couldn't build or test my app. In the end, I think that I found the problem. If this is your problem, then maybe this will help you. If not, good luck:
I have a Navigation View driven app that pulls files from the device and the web. The files are json files which contain menu items. All of the problems appeared to be coming from my base menu view which looked something like this:
//omit a bunch of stuff
NavigationView{
VStack {
//a bunch of HStacks and VStacks and buttons
}
.NavigationBarTitle(Text("someTitle"))
	 .toolbar {
ToolbarItem(...content: {
HStack {
spacer()
Button...
spacer()
Button...
spacer()
Button...
}
}
}
}
.onAppear(doSomeStuff)
//omit some more stuff
The ".toolbar" is what was causing the problems. I commented out the .toolbar bits. After testing, I reenabled all of my Spotlight checkboxes (see this thread for references), and remove "CoreSimulator" from my list of private areas to prevent spotlight from searching (also see this tread).
The app is back to its snappy self without any crashes.
When I add the .toolbar back in any location, the app goes back to causing problems. After removing one item at a time from the HStack of the ToolbarItem, I found that the problem was the use of the "padding()" in the HStack. Upon further testing, "spacer()" also causes a problem. Why? I don't know. But getting rid of the padding()s got rid of my problems.
One item worth noting: I suspect that the problem is somewhere around the auto layout bits of SwiftUI. I do not have other auto layout elements in place to test with so I cannot confirm the hypothesis.