I don't have a good solution to the problem but I've found a workaround. For me setting .navigationBarTitleDisplayMode(.inline) somehow fixed it. Maybe something related to the spacing of the navigation bar is messing it up?
Just putting this out here and hopefully it is helpful in identifying the real issue - I believe an inline title is not desirable in both of our cases, but unfortunately I couldn't find anything else.