It was my mistake. For others reference:
I had added the pushkit entitlement to my entitlements file via an expo plugin, which was throwing the provisioning profile. It only required the aps-environment entitlement.
The pushkit entitlement should not be there and was a mistake from copying over some old code.