Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Which hadoop version supports appending an existing file

Which hadoop version supports appending an existing file

New Contributor

Hi,

I am using Hadoop 2.7.1. I am not able to append an existing hdfs file. I want to know whether this version supports append functionality or not. If not, which version supports it?

Also, please let me know how to append using rhdfs package in R.

1 REPLY 1

Re: Which hadoop version supports appending an existing file

Super Collaborator

Can you better your use case for why you think you need to append files? HDFS is intended for a write-once, read many architecture.

The hadoop inputformat's support reading many files from an HDFS directory, and all contained files will be read.

MapReduce, Spark, Pig, Hive all support reading and writing files in that format.

If you really want this feature, fetch the file, append it, then overwrite the HDFS file

Don't have an account?
Coming from Hortonworks? Activate your account here