Basically add an option in game menu to ask about confirmation when you want to cancel one of the fleets.
When this option is turned off everything should work like it does now.
When this option is turned off everything should work like it does now.