The new version of WordPress (6.7) that was released this week added support for HEIC, which I think is going to magnify this bug significantly. I discovered that when I upload a PNG in the WordPress Block Editor, Safari is converting it to HEIC, and then WordPress is converting that to JPEG. And I did verify that the problem is because WordPress added accept="image/heic" to that particular file input. There are other places in WordPress where that's not present, and you can still upload PNGs in those locations.
There is no logical reason for Safari to convert a PNG to HEIC on upload — especially with no option to not do that. Just because the form says it supports a format, doesn't mean the user wants their file changed to that format.