Reply
Explorer
Posts: 16
Registered: ‎02-17-2015

Unable to write to a HDFS data node

Hi,

 

I just started playing with your VMWare based Quickstart VM. I find CDH very convenient to use. I'm using Clover ETL graph to write some data on to a file present in HDFS. When i use the "write to hdfs" component, the connectivity seems to be fine and i can see the file (text) present in hdfs via hue, the write operation is failing with the error:

 

File /tmp/bigdata_examples/key-value-pairs could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation.

 

Please let me know if you require any additional details, thanks. I suspect this to be some sort of a permission related issue.

 

Thanks

 

Cloudera Employee
Posts: 578
Registered: ‎01-20-2014

Re: Unable to write to a HDFS data node

Are you able to check the Namenode logs to see why the datanode is
being excluded? By default they'd be under /var/log/hadoop-hdfs

Regards,
Gautam Gopalakrishnan