Is it possible to run hadoop fs -getmerge in S3?

Question

I have an Elastic Map Reduce job which is writing some files in S3 and I want to concatenate all the files to produce a unique text file.

Currently, I'm manually copying the folder with all the files to our HDFS (hadoop fs copyFromLocal), then I'm running hadoop fs -getmerge and hadoop fs copyToLocal to obtain the file.

is there any way to use Hadoop fs directly on S3?

Answer 1

getmerge will expect a local destination so it will not work with S3.

Usage:

hadoop fs [generic options] -getmerge [-nl] <src> <localdst>