Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How can I concatenate files on HDFS?

How can I concatenate files on HDFS?

Explorer

We have a bunch of files in a directory that we'd like to concatenate into a single file. I've seen the question asked on Stack Overflow but the answers are not satifactory. It appears that there is a concat method on the FileSystem class in HDFS, but I don't see this method exposed in the HDFS shell. Why is this method not exposed to the HDFS shell? Is there an easy way to accomplish this task that we're missing?

Don't have an account?
Coming from Hortonworks? Activate your account here