I've searched the web and browsed the RDS docs, yet I can't seem to find an open connection limit.
For what it's worth, I'm planning on using the new Postgres flavour of RDS, but I suppose an answer from the mySQL side of the house would be acceptable as well.