That can be that expensive, so for an on-demand instance, it can be low around $12 per month for a micro instance, and can be much as $2750 per month for an r3.8xlarge. So it's better to keep a check on costs at least every few days or you can set up billing alerts.
To know about ElastiCache pricing, read here.
Do checkout aws certification training to learn more about AWS.