You can do so with Storage Explorer.
Go to storage explorer and connect your storage account with connection strings and then follow these steps:
1. Expand the Storage accounts
2. Expand your storage account
3. Click on Blob Containers
4. Right-click on your container that you want to rename
5. Select Rename from the menu