Adding some extra detail to aordway's answer - I had similar issues with FortiClient.app and FortiClientUninstaller.app
To remove the files that just would not go with any other method, I did the following in terminal;
cd /Applications
sudo chflags -hv noschg FortiClient.app
rm -R FortiClient.app