@TCloud, This looks like you are missing /user/tom directory in HDFS and job was probably trying to create something under your home directory as part of processing and failed due to directory missing and you are not allowed to create under /user directory. Please use "hdfs" user to create /user/tom directory, and update ownership to tom:tom, then try again. Cheers Eric ... View more

My apologies, I meant you CAN'T start or stop gateway roles, as there is no server, but only client configuration needed. Sorry about the confusion, I can't seem to edit my update anymore. Cheers ... View more

@Vinit_Kratin, You can't compare Hive with HBase directly, it is really use case dependent. It depends on how you want to store you data, how you will query your data, and whether you need to delete data etc and etc. You will need to explain a bit more on what you want to achieve before an answer can be given as to which is better, hive or hbase. Doing a quick google search returned me below useful links: https://community.cloudera.com/t5/Support-Questions/When-to-use-Hive-and-Hbase/m-p/206167 https://community.cloudera.com/t5/Community-Articles/The-Differences-between-Pig-Hive-and-HBase/ta-p/31007 https://www.dezyre.com/article/hive-vs-hbase-different-technologies-that-work-better-together/322 Cheers Eric ... View more

To check the version, go to CM's home page and on the top right corner, it will show CDH's version number. But I have replied to your another thread, it does sound like browser issue, not Hue issue. Cheers ... View more

@zoltanx_intel, Can you please confirm the version of CDH that you are using? I tested in my Hue lab and I can't see the issue that you described. Cheers Eric ... View more

@TCloud, You can start and stop Gateway roles, as they are client side roles. All you need to do is Deploy Client Config, so that configurations will be deployed on those gateway roles. Not sure if the memory issue is related, but at least you need to fix that first and see if there are further issues. Cheers Eric ... View more

Hi @TCloud, Based on the message below: 19/08/31 11:05:43 DEBUG security.UserGroupInformation: PrivilegedAction as:root (auth:SIMPLE) from:org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:719) It looks like client does not have correct kerberos config setup properly. Have you checked the configuration files under /etc/spark/conf? Have you added the host to have Spark Gateway role? Thanks Eric ... View more

@VijayM , Couple of questions: 1. Are CDH6 and CDH5 managed by same Cloudera Manager, or you manage yourself? 2. From the setting you applied below: spark.yarn.jars=local:/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/spark/jars/*,local:/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/spark/hive/*,local:/app/bds/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/spark/lib/* It looks like you have both CDH6.2 and CDH5.16 running on the same host, is that right? Any reason you want to do so? As @JosiahGoodson mentioned, spark2 and spark1 are not compatible, you should either have Spark1, or Spark2 jars in the classpath, not both, otherwise they will conflict. Cheers Eric ... View more