Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Error while copying files to hdfs

Error while copying files to hdfs

New Contributor

hdfs-copy-error.pngHi team we when trying to copy the data to hdfs I am getting error saying java.io.IOException:got error status message .Ack with firstBadLinkAs 128.10.42.86:1019.

Input data asize is around 10 GB

4 REPLIES 4

Re: Error while copying files to hdfs

Hi @Gokul Dighe

Issue seems to be the unstable Data node, check the Data node "128.10.42.86" for actual issue.

Re: Error while copying files to hdfs

New Contributor

@Sindhu -thanks for responding . can you please elaborate more on what do you mean by unstable data node.

Re: Error while copying files to hdfs

@Gokul Dighe

Error "Ack with firstBadLinkAs 128.10.42.86:1019." occurs when the Data node is unable to serve the block read requests. Please check the Data node logs for errors at the time of issue.

Re: Error while copying files to hdfs

@Gokul Dighe

it could be data node issue or your Firewall issue.

Here I'm not sure why you are using 1019 port for data node, ideally data node will use port 50010.

I think, if you are using 1019 as data node port, DataNode processes must be started as root On each DataNode host in the cluster,

use a text editor to modify /etc/hadoop/conf/hadoop-env.sh

export HADOOP_SECURE_DN_USER=$HDFS_USER