Member since
04-15-2016
13
Posts
0
Kudos Received
0
Solutions
05-13-2016
05:21 PM
1. NN data lost. Is it that the disk with NN directories crashed or have you deleted them? Is this with HA or non-HA. With non-HA, if both data directories of NN have no data, then you will run into data loss issues. You can revive and get to some state from secondary NN data directories but can not guarantee no data loss. If there is no useful data, you can always issue a NN format and start fresh. (You will need to manually update tez and mapreduce apps, you can get the information from manual install documentation) 2. Ambari not starting. Clean up /var/log and start it back. 3. Most likely HDFS services are not up. Filled up disk can kill processes. Once ambari is up, see which one is running and which one is not. Againt if NN data is lost, then NN will not start up.
... View more
03-03-2017
10:19 AM
I have set the variable in ~/.bashrc export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/usr/lcoal/Hbase/lib/hbase-client-1.2.4.jar but when i compile the code java -cp $HADOOP_CLASSPATH:/home/hadoopuser/Downloads/myjar.jar com.bigdata.uniquecoder.WordCountClass
It still gives me this error.
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration
at com.bigdata.uniquecoder.WordCountClass.main(WordCountClass.java:57)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 1 more Any help will be highly appreciated.
... View more
04-15-2016
02:36 PM
1 Kudo
@krishna sampath Ok, so for integrating custom java program to hbase, you probably need to add below path into your client java env for hbase. I believe it contains all required jars to connect. /usr/hdp/current/hbase-client/lib/ Or you also look on below path for more habse jars. /usr/hdp/current/hbase-master/lib/ For hive you can find all jars from below location. /usr/hdp/current/hive-client/lib/ Will that help?
... View more
04-15-2016
03:33 PM
3 Kudos
Hi @krishna sampath, do you want to read the classpath or add to it? To get the whole classpath, you just need to run this command: hadoop classpath If you want to add to it, you can do so in hadoop-env.sh. If you're using Ambari, you must update it in Ambari in the hadoop-env section of the HDFS configs and not on the filesystem directly, as Ambari will overwrite any changes you make to the config files directly.
... View more