How to find the node where ambari server runs ... View more

Folks On a typical Hadoop cluster, How to find out the admin node. Through Ambari, I am able to find Name, Data nodes. Is there any command or specific service I should be looking for ? Thanks Kumar ... View more

I am little confused while I am checking the version of spark : ON the server it says as follows : /usr/hdp/2.3.0.0-2557/spark [admin2.prod.iad spark]$ more RELEASE Spark 1.3.1.2.3.0.0-2557 built for Hadoop 2.7.1.2.3.0.0-2557 Whereas on Ambari it says as follows : Spark 1.5.2.2.3 Installed Apache Spark is a fast and general engine for large-scale data processing. which one is the right one. Also on Ambari the status says "Installed", what does this mean ? ... View more

I was given an environment to support recently without proper documentation and knowledge transfer. I am looking to document something like Node Name List of services it runs Is there any easy way to get the list of services rather than logging into each box ? Specifically I am looking for the box which acts as Ambari server and I believe this is where Ambari Metrics collector process runs and all Ambari metrics monitor process pushes the data to this server. Please correct me if I am wrong. ... View more

In the gateway cluster, one of the node is having issues. I am just running this command "hadoop dfsadmin -report|awk 'FNR == 3 {print $3}'" to get the remaining size and I get the following error message : [gw2.prod.dfw ~]$ hadoop dfsadmin -report|awk 'FNR == 3 {print $3}' the Exception in thread "main" java.lang.NoClassDefFoundError: ___31598 Caused by: java.lang.ClassNotFoundException: ___31598 at java.net.URLClassLoader$1.run(URLClassLoader.java:217) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at java.lang.ClassLoader.loadClass(ClassLoader.java:323) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) at java.lang.ClassLoader.loadClass(ClassLoader.java:268) Could not find the main class: ___31598. Program will exit. the same command is running fine from the other node. This is Hadoop V1. Please advise. ... View more

I have got a local user on one of the Gateway Node and I am trying to query one of the HIVE table using the local user account. Looks like I need do not have enough permissions and following is the error message : Job Submission failed with exception 'org.apache.hadoop.security.AccessControlException(org.apache.hadoop.security.AccessControlException: Permission denied: user=XXXXXX, access=WRITE, inode="/user":hdfs:hdfs:Drwxr-xr-x)' FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask Please advise what should be my next step to get access ... View more