I have had similar experiences and agree with this answer. Additionally, it seems that app installation, console logging, etc. can all be switched to USB normally, only the debugger won't switch. Everything goes fast if I deselect 'Debug executable', but as soon as debugging starts, the speed becomes as slow as using a WiFi connection.