In able to connect your Database to your web app, you need to go to your SQL database and make a copy of connection string. After that, go to your web app and then go to All settings and All settings there is an option called Application Settings. Then, update the connection string with your username and password. Or, create a new connection string.
I hope this will help.
Want to become an Azure expert? join azure developer certification now!!
Want to know more about Azure SQL? Watch this video on Deploy SQL Database in Azure | Azure SQL :