You can only cancel invites that are pending and have not been accepted. Sub - users who already accepted an invite will need to be deactivated (click here to see how).
To cancel an invite, click on Manage Users. Invites that have not been accepted will show as Pending.
Click on the pending user and select Deactivate