Full Keyboard Access is not working in a SwiftUI ScrollView.

I am having a hard time making Full Keyboard Access work properly in a ScrollView using just a simple sample app with the following view:

Code Block swift
    var body: some View {
        ScrollView {
            Button("Button 1", action: {})
            Button("Button 2", action: {})
        }
    }

I have a device running on 14.5 with Full Keyboard Access and a connected physical keyboard. When I launch the app, the buttons are not navigable at all. However when I option+tab between an another app that has an active focused element and back again, then the buttons become focusable some of the times. Could this be a bug in the framework, a coding error or a user error?