i have the same issue i'm using spark 2.4.4 and hive 3.1.2 and hadoop 3.2.1: -  error message GIven below ------------->  i'm doing  scala sbt project      13:03:38.626 [main] DEBUG org.apache.hadoop.util.Shell - Failed to detect a valid hadoop home directory java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset. at org.apache.hadoop.util.Shell.checkHadoopHomeInner(Shell.java:469) ~[hadoop-common-3.1.0.jar:na] at org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:440) ~[hadoop-common-3.1.0.jar:na] at org.apache.hadoop.util.Shell.<clinit>(Shell.java:517) ~[hadoop-common-3.1.0.jar:na] at org.apache.hadoop.hive.conf.HiveConf$ConfVars.findHadoopBinary(HiveConf.java:2327) [hive-exec-1.2.1.spark2.jar:1.2.1.spark2] at org.apache.hadoop.hive.conf.HiveConf$ConfVars.<clinit>(HiveConf.java:365) [hive-exec-1.2.1.spark2.jar:1.2.1.spark2] at org.apache.hadoop.hive.conf.HiveConf.<clinit>(HiveConf.java:105) [hive-exec-1.2.1.spark2.jar:1.2.1.spark2] at java.lang.Class.forName0(Native Method) [na:1.8.0_252] at java.lang.Class.forName(Class.java:348) [na:1.8.0_252] at org.apache.spark.util.Utils$.classForName(Utils.scala:238) [spark-core_2.11-2.4.4.jar:2.4.4] at org.apache.spark.sql.SparkSession$.hiveClassesArePresent(SparkSession.scala:1117) [spark-sql_2.11-2.4.4.jar:2.4.4] at org.apache.spark.sql.SparkSession$Builder.enableHiveSupport(SparkSession.scala:866) [spark-sql_2.11-2.4.4.jar:2.4.4] at UpsertFeature$.<init>(UpsertFeature.scala:20) [classes/:na] at UpsertFeature$.<clinit>(UpsertFeature.scala) [classes/:na] at UpsertFeature.main(UpsertFeature.scala) [classes/:na] 13:03:38.788 [main] DEBUG org.apache.hadoop.util.Shell - setsid exited with exit code 0 Exception in thread "main" java.lang.ExceptionInInitializerError         ... View more