XCode 11: build fail, get an error 'Abort trap: 6' (worked in XCode 10.3)

When trying to build my project in in Xcode11.0 or Xcode 11.1, I am getting the following failures. But the same project can be build in Xcode 10.3.

I had changed the Swift compiler optimizations to None -Onone, but it doesn't help. Don't know what to do now.

---
2. While running pass #0 SILModuleTransform "SerializeSILPass".
3. While serializing declaration 0x11634e018 (in module 'XiaoYan')
4. failed to serialize anything
0  swift                    0x000000010dbbfeb3 PrintStackTraceSignalHandler(void*) + 51
1  swift                    0x000000010dbbf686 SignalHandler(int) + 358
2  libsystem_platform.dylib 0x00007fff71f0ab5d _sigtramp + 29
3  libsystem_platform.dylib 0x00007ffee64808a0 _sigtramp + 1951882592
4  libsystem_c.dylib        0x00007fff71dc46a6 abort + 127
5  swift                    0x000000010a4a34ca swift::serialization::Serializer::writeDecl(swift::Decl const*) + 68458
6  swift                    0x000000010a4b9b3f swift::serialization::Serializer::writeAllDeclsAndTypes() + 62287
7  swift                    0x000000010a4c6b04 swift::serialization::Serializer::writeAST(llvm::PointerUnion<swift::ModuleDecl*, swift::SourceFile*>, bool) + 5364
8  swift                    0x000000010a4d3a30 swift::serialization::Serializer::writeToStream(llvm::raw_ostream&, llvm::PointerUnion<swift::ModuleDecl*, swift::SourceFile*>, swift::SILModule const*, swift::SerializationOptions const&) + 6000
9  swift                    0x000000010a4d530b bool llvm::function_ref<bool (llvm::raw_pwrite_stream&)>::callback_fn<swift::serialize(llvm::PointerUnion<swift::ModuleDecl*, swift::SourceFile*>, swift::SerializationOptions const&, swift::SILModule const*)::$_8>(long, llvm::raw_pwrite_stream&) + 139
10 swift                    0x00000001097e5079 swift::withOutputFile(swift::DiagnosticEngine&, llvm::StringRef, llvm::function_ref<bool (llvm::raw_pwrite_stream&)>) + 2569
11 swift                    0x000000010a4d5167 swift::serialize(llvm::PointerUnion<swift::ModuleDecl*, swift::SourceFile*>, swift::SerializationOptions const&, swift::SILModule const*) + 311
12 swift                    0x0000000109820aab std::__1::__function::__func<performCompileStepsPostSILGen(swift::CompilerInstance&, swift::CompilerInvocation&, std::__1::unique_ptr<swift::SILModule, std::__1::default_delete<swift::SILModule> >, bool, llvm::PointerUnion<swift::ModuleDecl*, swift::SourceFile*>, swift::PrimarySpecificPaths const&, in
, swift::FrontendObserver*, swift::UnifiedStatsReporter*)::$_12, std::__1::allocator<performCompileStepsPosmpilerInstance&, swift::CompilerInvocation&, std::__1::unique_ptr<swift::SILModule, std::__1::default_delete<swift::SILModule> >, bool, llvm::PointerUnion<swift::ModuleDecl*, swift::SourceFile*>, swift::PrimarySpecificPaths const&, bool, int&, swift::FrontendObserver*, swift::UnifiedStatsReporter*)::$_12>, void ()>::operator()() + 603
13 swift                    0x0000000109fc8391 SerializeSILPass::run() + 49
14 swift                    0x0000000109ebea29 swift::SILPassManager::execute() + 7305
15 swift                    0x0000000109b1b5bb swift::CompilerInstance::performSILProcessing(swift::SILModule*, swift::UnifiedStatsReporter*) + 1563
16 swift                    0x0000000109816cc5 performCompile(swift::CompilerInstance&, swift::CompilerInvocation&, llvm::ArrayRef<char const*>, int&, swift::FrontendObserver*, swift::UnifiedStatsReporter*) + 33925
17 swift                    0x000000010980b034 swift::performFrontend(llvm::ArrayRef<char const*>, char const*, void*, swift::FrontendObserver*) + 68
18 swift                    0x00000001097985a3 main + 1219
19 libdyld.dylib            0x00007fff71d1f3d5 start + 1
20 libdyld.dylib            0x0000000000000097 start + 2385382595
error: Abort trap: 6 (in target 'XiaoYan' from project 'XiaoYan')