AWS S3 does not support FTP directly. You can use AWS CLI to do that or AWS SDKs, even then the objects will be uploaded one at a time.
You can use this command to this operation:
aws s3 sync <source> s3://my-bucket/path
<source> - Mention the directory over here
sync - use this command for operations with a source directory and a destination bucket