Member since
02-05-2016
14
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2917 | 09-21-2016 03:45 PM |
06-07-2020
12:37 AM
i have the same issue i'm using spark 2.4.4 and hive 3.1.2 and hadoop 3.2.1: - error message GIven below -------------> i'm doing scala sbt project 13:03:38.626 [main] DEBUG org.apache.hadoop.util.Shell - Failed to detect a valid hadoop home directory
java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset.
at org.apache.hadoop.util.Shell.checkHadoopHomeInner(Shell.java:469) ~[hadoop-common-3.1.0.jar:na]
at org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:440) ~[hadoop-common-3.1.0.jar:na]
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:517) ~[hadoop-common-3.1.0.jar:na]
at org.apache.hadoop.hive.conf.HiveConf$ConfVars.findHadoopBinary(HiveConf.java:2327) [hive-exec-1.2.1.spark2.jar:1.2.1.spark2]
at org.apache.hadoop.hive.conf.HiveConf$ConfVars.<clinit>(HiveConf.java:365) [hive-exec-1.2.1.spark2.jar:1.2.1.spark2]
at org.apache.hadoop.hive.conf.HiveConf.<clinit>(HiveConf.java:105) [hive-exec-1.2.1.spark2.jar:1.2.1.spark2]
at java.lang.Class.forName0(Native Method) [na:1.8.0_252]
at java.lang.Class.forName(Class.java:348) [na:1.8.0_252]
at org.apache.spark.util.Utils$.classForName(Utils.scala:238) [spark-core_2.11-2.4.4.jar:2.4.4]
at org.apache.spark.sql.SparkSession$.hiveClassesArePresent(SparkSession.scala:1117) [spark-sql_2.11-2.4.4.jar:2.4.4]
at org.apache.spark.sql.SparkSession$Builder.enableHiveSupport(SparkSession.scala:866) [spark-sql_2.11-2.4.4.jar:2.4.4]
at UpsertFeature$.<init>(UpsertFeature.scala:20) [classes/:na]
at UpsertFeature$.<clinit>(UpsertFeature.scala) [classes/:na]
at UpsertFeature.main(UpsertFeature.scala) [classes/:na]
13:03:38.788 [main] DEBUG org.apache.hadoop.util.Shell - setsid exited with exit code 0
Exception in thread "main" java.lang.ExceptionInInitializerError
... View more
04-17-2020
09:49 PM
Have you been able to solve this issue. Getting exact same issue. Wanted to know how you resolve it Thanks
... View more
05-14-2018
12:25 PM
@rachana sri Your log shows that it is trying to connect the localhost:2181 zookeeper. issuing: !connect jdbc:phoenix:localhost:2181:/hbase none none org.apache.phoenix.jdbc.PhoenixDriver Connecting to jdbc:phoenix:localhost:2181:/hbase Are you sure that you have a Zookeeper pro cess running on "localhost:2181" address? Please check if port 2181 is opened and listening to correct address? Also please check the port 16020 as we see 16020 failed on local exception # netstat -tnlpa | grep 2181
# netstat -tnlpa | grep 16020
Please try specifying the hostname. Like if you have the zookeeper running on a remote host (like test1.example.com) then please try specifying the Hostname. # ./sqlline.py test1.example.com:2181/hbase . Also as we repeatedly see "No route to host" please let us know if you are using correct hostnames/FQDN "hostname -f" ? java.io.IOException: Call to / :16020 failed on local exception: java.net.NoRouteToHostException: No route to host Mon May Are you using correct hostname for your services and Do you have the Firewall Turned Off and able to access the services using their Hostname & ports like using telnet? # hostname -f
# telnet $HOSTNAME $PORT
. .
... View more
09-21-2016
03:45 PM
This was fixed by modifying email version tag.
... View more