sarm
sarm
Explorer

Datnode is not alive tough datanode is up

by Explorer sarm in Support Questions
‎09-16-2020 01:02 AM
‎09-16-2020 01:02 AM
We have 3 datanodes in and only 2 datanodes are alive tough 3 datanodes are up ,amoung 3 datanodes 2 datanodes are in default rack and 1 datanode is in specified rack ,datanode in specified rack is not going live   tied refreshing and restarting of entire hdfs ,nothing helped  could see below error in logs    2020-09-16 13:13:24,006 ERROR Error: can't add leaf node /AZ/EUS2/ambari/0/0.0.0.1:50010 at depth 6 to topology:Number of rcks: 1 Expected number of leaves:2 /default-rack/0.0.0.2:50010 /default-rack/0.0.0.3:50010 2020-09-16 13:13:24,007 WARN IPC Server handler 182 on 8020, call Call#419 Retry#0 org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol.registerDatanode from 0.0.0.4:54685 org.apache.hadoop.net.NetworkTopology$InvalidTopologyException: Failed to add /AZ/EUS2/ambari//0/0.0.0.1:50010: You cannot have a rack and a non-rack node at the same level of the network topology. at org.apache.hadoop.net.NetworkTopology.add(NetworkTopology.java:134) at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.registerDatanode(DatanodeManager.java:1135) at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.registerDatanode(BlockManager.java:2354) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.registerDatanode(FSNamesystem.java:3830) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.registerDatanode(NameNodeRpcServer.java:1490) at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTranslatorPB.registerDatanode(DatanodeProtocolServerSideTranslatorPB.java:101) at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(DatanodeProtocolProtos.java:31658) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:524) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1025) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:876) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:822) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:268 ... View more
Labels:

Spark Job Failure

by Explorer sarm in Support Questions
‎08-20-2020 03:45 AM
‎08-20-2020 03:45 AM
Spark Job is failing with below error ,i see the below errors in yarn application log    20/08/19 20:38:10 ERROR Executor: Exception in task 1481.0 in stage 60.0 (TID 43008) java.io.IOException: Filesystem closed   ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM   Can anyone help me to understand what will the cause of above error in yarn application log  ... View more

Datanode Heap Size computation

by Explorer sarm in Support Questions
‎07-07-2020 04:53 AM
‎07-07-2020 04:53 AM
Hi All,    Can some one help with the document/steps/formula to calculate the datanode heap size when configuring fresh cluster      ... View more
Labels:

Re: Disc partion grid0 consumes more space than ot...

by Explorer sarm in Support Questions
‎06-29-2020 08:25 AM
‎06-29-2020 08:25 AM
Hi @Govins ,   Thanks for your reply ..!! Do you want any particular property that need to check for configuration related to data storage      ... View more

Disc partion grid0 consumes more space than other ...

by Explorer sarm in Support Questions
‎06-29-2020 07:48 AM
‎06-29-2020 07:48 AM
Hi team ,   In our cluster in all the datanodes particular disc grid0 is consuming more utilization that other disc like grid1 grid2 grid3    when i put df -h in datanodes    datanode1: grid0 conumes 80% grid1 consumes 60% grid2 consumes 63% ..............same upto grid 11 datanode2: grid0 consumes 80% grid consumes  65% .........same upto grid11   why the grid0 alone consuming more utilization?will running balance fix this issue ?   Any help is appreciated Thanks         ... View more
Labels:

is there a way to make a hdfs block corrupted ?

by Explorer sarm in Support Questions
‎06-10-2020 06:36 AM
‎06-10-2020 06:36 AM
Is there a way ,i can make a hdfs block as corrupted  ... View more
Labels:

Re: Changing Password for HDFS service user

by Explorer sarm in Support Questions
‎05-25-2020 09:53 PM
‎05-25-2020 09:53 PM
Hi @Madhur ,   Thanks for responding ..!! 1)  Is the cluster on which you are planning to change password is kerberized ? yes the cluster is kerberized  2) 2) Do you use CM or Ambari for managing your cluster?  I use Ambari for Managing the cluster    ... View more

Changing Password for HDFS service user

by Explorer sarm in Support Questions
‎05-20-2020 02:17 AM
‎05-20-2020 02:17 AM
if i change the passoword for hdfs service account ,will if affect any of the services like hdfs,yarn,hbase,hive...     ... View more
Labels:

How to compare Configuration of two HDP cluster

by Explorer sarm in Support Questions
‎04-20-2020 06:15 AM
‎04-20-2020 06:15 AM
How can i compare the cluster configurations of two HDP clusters using curl API  Any help is appreciated    Thanks in Advance ...!!! ... View more

Comparing all the Service Properties of two CDH cl...

by Explorer sarm in Support Questions
‎04-17-2020 04:57 AM
‎04-17-2020 04:57 AM
How can i compare two Cloudera CDH clusters ,is there any script available to compare two clusters    Thanks in Advance ... View more

Re: Curl Commend for Changing HDFS Permission

by Explorer sarm in Support Questions
‎04-16-2020 06:07 AM
‎04-16-2020 06:07 AM
@stevenmatison Thanks for the Update    The commend you mention will change the owner and group for the Path we are giving  It will not change the owner and group for all the files under the directory  I am looking for the curl to change the owner and group permissions recursively      ... View more

Curl Commend for Changing HDFS Permission

by Explorer sarm in Support Questions
‎04-15-2020 09:33 PM
‎04-15-2020 09:33 PM
What will  be the Equivalent Curl commend for hdfs dfs -chown <owner> -R <path>   I ... View more
Labels:

Name Node UI ,RM UI are not able to access

by Explorer sarm in Support Questions
‎04-14-2020 03:08 AM
‎04-14-2020 03:08 AM
I am not able to access any of the UI from Ambari (eg Namenode UI ,RM UI) ,when i try to curl the particular UI i am able to get the output    Any help is appreciated .   Thanks in Advance  ... View more

Re: Curl throws error when running allow snapshot

by Explorer sarm in Support Questions
‎04-13-2020 09:50 PM
‎04-13-2020 09:50 PM
Hi @jsensharma  ,   Thanks for your comments .!!   I believe i am using lower version of hadoop that is why the reason i am facing the issue    Hadoop 2.7.3.2.6.5.0-292 Subversion git@github.com:hortonworks/hadoop.git -r 3091053c59a62c82d82c9f778c48bde5ef0a89a1 Compiled by jenkins on 2018-05-11T07:53Z Compiled with protoc 2.5.0 From source with checksum abed71da5bc89062f6f6711179f2058 This command was run using /usr/hdp/2.6.5.0-292/hadoop/hadoop-common-2.7.3.2.6.5.0-292.jar   #javap -cp /usr/hdp/2.6.5.0-292/hadoop-hdfs//hadoop-hdfs-2.7.3.2.6.5.0-292.jar org.apache.hadoop.hdfs.web.resources.PutOpParam.Op Compiled from "PutOpParam.java" public final class org.apache.hadoop.hdfs.web.resources.PutOpParam$Op extends java.lang.Enum<org.apache.hadoop.hdfs.web.resources.PutOpParam$Op> implements org.apache.hadoop.hdfs.web.resources.HttpOpParam$Op { public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op CREATE; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op MKDIRS; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op CREATESYMLINK; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op RENAME; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op SETREPLICATION; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op SETOWNER; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op SETPERMISSION; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op SETTIMES; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op RENEWDELEGATIONTOKEN; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op CANCELDELEGATIONTOKEN; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op MODIFYACLENTRIES; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op REMOVEACLENTRIES; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op REMOVEDEFAULTACL; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op REMOVEACL; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op SETACL; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op SETXATTR; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op REMOVEXATTR; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op CREATESNAPSHOT; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op RENAMESNAPSHOT; public static final org.apache.hadoop.hdfs.web.resources.PutOpParam$Op NULL; final boolean doOutputAndRedirect; final int expectedHttpResponseCode; final boolean requireAuth; public static org.apache.hadoop.hdfs.web.resources.PutOpParam$Op[] values(); public static org.apache.hadoop.hdfs.web.resources.PutOpParam$Op valueOf(java.lang.String); public org.apache.hadoop.hdfs.web.resources.HttpOpParam$Type getType(); public boolean getRequireAuth(); public boolean getDoOutput(); public boolean getRedirect(); public int getExpectedHttpResponseCode(); public java.lang.String toQueryString(); static {}; }   ... View more

Curl throws error when running allow snapshot

by Explorer sarm in Support Questions
‎04-13-2020 08:36 PM
‎04-13-2020 08:36 PM
Hi All ,   I am trying to make a directory as a snapshot directory using curl API ,when i run the curl for Allowsnapshot it throws below error    Any help is Appreciated.. Thanks in Advance ..!!     curl -i -X PUT "http://internal:50070/webhdfs/v1/dummy/?op=DISALLOWSNAPSHOT" HTTP/1.1 400 Bad Request Cache-Control: no-cache Expires: Tue, 14 Apr 2020 03:26:30 GMT Date: Tue, 14 Apr 2020 03:26:30 GMT Pragma: no-cache Expires: Tue, 14 Apr 2020 03:26:30 GMT Date: Tue, 14 Apr 2020 03:26:30 GMT Pragma: no-cache Content-Type: application/json X-FRAME-OPTIONS: SAMEORIGIN Transfer-Encoding: chunked Server: Jetty(6.1.26.hwx) {"RemoteException":{"exception":"IllegalArgumentException","javaClassName":"java.lang.IllegalArgumentException","message":"Invalid value for webhdfs parameter \"op\": No enum constant org.apache.hadoop.hdfs.web.resources.PutOpParam.Op.DISALLOWSNAPSHOT"}}[ ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎09-20-2020 11:50 PM
Public Statistics
Date Registered ‎05-20-2019 06:31 PM
Last Visited ‎09-20-2020 11:50 PM
Total Messages Posted 15