Intellipaat Back

Explore Courses Blog Tutorials Interview Questions
0 votes
3 views
in AWS by (5.6k points)
I'm designing an application that has an input file ranging from 1-30 GB uploaded to the S3 bucket every 15 mins. So what it does, it splits the file into "n" numbers of small files into 3 different S3 buckets in 3 different AWS regions. After that 3 loader applications read these files from the respective S3 buckets and load the data into the respective aerospike cluster.

I wish to use the AWS lambda function to split the file as well as to load the data. Also recently I came across the AWS step function which can also serve the same purpose. But I'm not sure which one to go with and which would be cheaper in terms of pricing.

1 Answer

0 votes
by (12.4k points)

AWS Step functions are best at coordinating workflows that involve multiple predefined steps. Also, it can do parallel tasks and error handling well as it uses Lambda functions to perform each task.

Based on your use case, the AWS step function sounds good and it adds a very small additional charge on top of Lambda.

Interested in learning AWS? Check out: AWS Certification

Related questions

0 votes
1 answer
Want to get 50% Hike on your Salary?

Learn how we helped 50,000+ professionals like you !

0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

31k questions

32.8k answers

501 comments

693 users

Browse Categories

...