I found that my associated domain having ?mode=developer was preventing the universal link from opening my application.
I removed it as my understanding this is only necessary if you want to skip the cached version of your apple-app-site-association from Apple's CDN. Once that file is cached and doesn't change, it doesn't matter anymore.