So log into your AWS account, Go to RDS and select your database. Make it publicly accessible by ensuring that Public Accessibility is yes and also add your IP address to SG. Now add a new rule within the Security Group, Edit inbound rule & add a new rule, select the type to be MYSQL or Aurora, Protocol be TCP by default, provide the port range to be 3306 & source be my IP. Once done now fill all the information required in MySql Workbench.
Interested in learning AWS, do check out: aws certification training