Hi, I was previously working Hive 1.2.1000.2.6.5.0-292. When i create a ORC table like below: CREATE TABLE acidtbl2 (a INT, b STRING) STORED AS orc tblproperties ("orc.compress"="SNAPPY");   And insert data into it: INSERT INTO acidtbl2 (a,b) VALUES (100, "oranges"), (200, "apples"), (300,"bananas");   I get a the following directory which contains the data file as below:   hdfs dfs -ls /apps/hive/warehouse/imp_rt_test1912.db/acidtbl1/ Found 1 items -rwxrwxrwx 3 bdauser hdfs 380 2020-02-15 10:52 /apps/hive/warehouse/imp_rt_test1912.db/acidtbl2/000000_0   Now with Hive 3.1 if I do the same , I get a delta folder and withing it i see a file named bucket_00000    hdfs dfs -ls /warehouse/tablespace/managed/hive/hdptesta.db/acidtbl2/ Found 1 items drwxrwx---+ - bdauser hadoop 0 2020-02-15 10:59 /warehouse/tablespace/managed/hive/hdptesta.db/acidtbl2/delta_0000001_0000001_0000   Is there a way to have the bucketing disabled so that bucket files dont get generated?   Thanks, Kevin ... View more

Hi, I am upgrading from hdp2.6.3 to hdp3.1.4. Post upgrade am getting the following error when running one of my jobs   Caused by: java.lang.ClassNotFoundException: org.apache.hbase.thirdparty.com.google.common.cache.CacheLoader at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357 I see that the jar containing this class is hbase-shaded-miscellaneous-2.2.0.jar and is present in  /usr/hdp/3.1.4.0-315/hbase/lib/hbase-shaded-miscellaneous-2.2.0.jar /usr/hdp/3.1.4.0-315/spark2/jars/hbase-shaded-miscellaneous-2.2.0.jar   I can see that the spark2-hdp-yarn-archive.tar.gz created in /hadoop/yarn/local/filecache/0/11837/spark2-hdp-yarn-archive.tar.gz does not contain this jar file.   When I add the jar explicity to my spark-submit command by appending it to --jars option and adding it to conf as below , I dont see this error , --conf "spark.driver.extraClassPath=/usr/hdp/3.1.4.0-315/spark2/jars/hbase-protocol-shaded-2.0.2.3.1.4.0-315.jar     Progressing in above manner I then get another ClassNotfound for another shaded class in hbase-protocol-shaded-2.0.2.3.1.4.0-315.jar.    Can I get some pointers on what the issue may be. Other jars like hbase-client-2.0.2.3.1.4.0-315.jar etc are not giving this issue.   Thanks, Kevin Mathrani   ... View more