question Re: Urgent..please help me...2 data nodes goes down. in Archives of Support Questions (Read Only)

Urgent..please help me...2 data nodes goes down.

g_rao9704 — Wed, 20 Jul 2016 10:03:54 GMT

i have added dfs.namenode.acls.enable =true in hdfs..i have 4 data node cluster with HDP 2.1.2..i restart the services

Re: Urgent..please help me...2 data nodes goes down.

sunile_manjee — Wed, 20 Jul 2016 10:08:39 GMT

@sankar rao can you add here what you see in the log file?

Re: Urgent..please help me...2 data nodes goes down.

g_rao9704 — Wed, 20 Jul 2016 10:11:56 GMT

@Sunile Manjee

i new this hadoop env..can please assist me where clould i found log file?

Re: Urgent..please help me...2 data nodes goes down.

bandarusridhar1 — Wed, 20 Jul 2016 10:42:32 GMT

@sankar rao

Please log to server where datanodes are down

cd /var/log/hadoop/hdfs
ll -ltr

there you can find the file like this hadoop-hdfs-datanode-(hostname).log

tail -300f hadoop-hdfs-datanode-(hostname).log

and paste the output here for analysing the issue.

Re: Urgent..please help me...2 data nodes goes down.

TimothySpann — Wed, 20 Jul 2016 10:45:23 GMT

true is spelled wrong

Re: Urgent..please help me...2 data nodes goes down.

g_rao9704 — Wed, 20 Jul 2016 11:03:41 GMT

i found hadoop-hdfs-namenode-(hostname).log but i con't datanode...i found this in cd /var/opt/teradata/log/hadoop directory in my system...

Re: Urgent..please help me...2 data nodes goes down.

bandarusridhar1 — Wed, 20 Jul 2016 11:26:10 GMT

@sankar rao

check for Hadoop Log Dir Prefix property location In Ambari-->HDFS-->>Advance Hadoop env. Location pointing to that property, there you can find log files.

You need to check on datanode server.

Link

Re: Urgent..please help me...2 data nodes goes down.

g_rao9704 — Wed, 20 Jul 2016 12:33:00 GMT

@SBandaru

it there like this .../var/opt/teradata/log/hadoop

while i go to cd //var/opt/teradata/log/hadoop ..i couldn't find any datanode..i can find namenode,zkfc,journalnode..etc but i con't see data node..

Re: Urgent..please help me...2 data nodes goes down.

g_rao9704 — Wed, 20 Jul 2016 14:47:00 GMT

Hi..tq for your time guys..i just restart the datanodes..now all nodes are up..the is resolved..but one issue(alert) left that is block health issue( correcpted blocks 108,under replicated blokcs: 500) not resolved...should i need to run hadoop fs -fsck command?

Re: Urgent..please help me...2 data nodes goes down.

ashneesharma88 — Thu, 28 Jul 2016 20:19:51 GMT

Yes you have to run fsk command

https://community.hortonworks.com/articles/4427/fix-under-replicated-blocks-in-hdfs-manually.html