Hi,   There is a KB article related to this issue, please review this below: https://community.cloudera.com/t5/Customer/Permission-denied-when-accessing-Hive-tables-from-Spark-in/ta-p/310498   Regards, Chethan YM ... View more

Hi ,   There seems to be a UDF present for SK in Hive, Have you tried this? Is it Working? https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/using-hiveql/topics/hive_surrogate_keys.html   Regards, Chethan YM ... View more

Hi @gocham ,   In CDP 7.1.7 Capacity Scheduler is alone supported and Fair Scheduler is not supported, Capacity Scheduler is the default and only supported scheduler. You must transition from Fair Scheduler to Capacity Scheduler when upgrading your cluster to CDP Private Cloud Base.   This is the related Jira from Cloudera - CLR-106983   Note: If i answered your question please give a thumbs up and accept it as a solution.   Regards, Chethan YM ... View more

Hi @Ramesh_hdp    I do not think we have an option to check number of users are logged into Hive, But we can check how many connections are made to Hive.   >you can refer the below article: https://community.cloudera.com/t5/Support-Questions/How-to-get-number-of-live-connections-with-HiveServer2-HDP-2/td-p/106284   >If you enable Hiveserver2 UI then under Active Sessions you can see which user connected from which IP   Regards, Chethan YM ... View more

Hi @Iga21207 ,   So how it works in catalod is when you run any refresh commands then that is executed sequentially and once that is completed then it goes to next one. It doesn't run in parallel as per the catalogd which is a single threaded operation. There is a lock that catalogd thread creates on class getCatalogObjects().   So when you are refreshing(means they have not completed yet sequentially) and after that when the new request came in then the Catalog threw the error on that table as it can't get the lock because the lock is already there on previous table on which the refresh command was running.   Not sure on your CDH version, This may resolved in Higher version of CDP/CDH.   Note: If i answered your question please give a thumbs up and accept it as a solution.   Regards, Chethan YM     ... View more

Hi,   After you run the query you need to look at the query profile to analyse the complete memory. look for “Per node peak memory usage” in the profile to understand how much memory each host or impala daemon used to run this query.   For above snippet from your side it looks like this query has the 3gb max limit to run the query, this can be set at session level or in impala admission control pool. If you provide the complete query profile i think we can get more details. Regards, Chethan YM   ... View more