Is AWS CloudSearch Scalable?

Question

I have around 500 MB of data to be pushed to cloud search. When I tried to upload it directly from the console there is a 5 MB limitation and when I tried using S3 and then when I give S3 URL it fails and tried with the command line but still got the error: 

Error parsing parameter '--documents': Blob values must be a path to a file.

Any way to get CloudSearch work?

Answer 1

The best solution would be to upload the data in chunks. Break your document into batches and upload them in batches.

The advantage with this is that, if you have multiple documents to submit, submit them all in a single call rather than always submitting batches of size 1.

As per AWS documentation, AWS recommends to group (up to 5 MB) and send in one call. Each 1,000 batch calls cost you around $0.10, so grouping also saves you some money.

But in case, if you wish to increase the limits, you can Contact Amazon CloudSearch.

Learn more about AWS by going through AWS Developer Training Online and master this technology