XCode Cloud ignores maximumTestExecutionTimeAllowance specified in test plan

I've created a test plan that includes the below configurations.

{"configurations": [{
    ...
    "options": {
        "defaultTestExecutionTimeAllowance" : 60,
         "maximumTestExecutionTimeAllowance" : 60,
         "testTimeoutsEnabled" : true
    }],
  "defaultOptions": {
        "defaultTestExecutionTimeAllowance" : 60,
        "maximumTestExecutionTimeAllowance" : 60,
        "testTimeoutsEnabled" : true,
        ....
}
...
}

If I write a test that intentionally will take longer than 60 seconds, executing the test locally fails as expected with the error message Test exceeded execution time allowance of 1 minute

  let app = XCUIApplication()
        app.launch()
        let missingButton = app.buttons.firstMatch
        XCTAssertTrue(missingButton.waitForExistence(timeout: 120), "When a timeout is > 60 seconds, the default max setting of 60 seconds is still enforced")

However, when this test is run using this test plan in XCode Cloud, it reports that it took 124 seconds to run and there is no message about exceeding execution time allowance.

How can the test step be configured in XCode Cloud to ensure that the execution time allowances are respected?

Replies

This seems like a possible bug in Xcode Cloud. Have you filed a feedback report on this issue?