Actually, you can delete after emptying bucket, and when you're using the AWS Management Console, you can delete a bucket that contains objects.
And Amazon will charge for the objects present in the bucket according to the storage class types. For deleting the bucket refer to the below link that will provide you more clarification and explanation refer to this AWS Documentation.
For more information, check out this AWS Tutorial.