I had this issue when a submission was started for a release but wasn't submitted for review, so it was just sort of pending. I found that I could "edit" the submission by changing the version number under General App Information and then removing previous build and choosing a newer more recent build.
I know this doesn't "delete" the submission but it's a way to edit it without having to submit it for review and cancelling it.