Member since
03-29-2020
110
Posts
10
Kudos Received
16
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1494 | 01-08-2022 07:17 PM | |
| 4269 | 09-22-2021 09:39 AM | |
| 16938 | 09-14-2021 04:21 AM | |
| 3315 | 09-01-2021 10:28 PM | |
| 4633 | 08-31-2021 08:04 PM |
08-13-2021
04:50 AM
1 Kudo
Hi @amitshanker Thanks for the update. I can see than you had set hive.server2.webui.use.spnego as true, that means kerberos is enabled in your cluster. If spnego and kerberos are enabled then few settings needs to be changed in browser. Could you please follow the below link. https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cdh_sg_browser_access_kerberos_protected_url.html
... View more
08-12-2021
09:37 PM
1 Kudo
Thanks for the details. Can you share the hive-site.xml file Can you share me the complete screenshot of the error you are facing Do you have kerberos enabled in your cluster?
... View more
08-12-2021
01:46 AM
1 Kudo
Hi @amitshanker Could you let me know whether you are using CDH/HDP/CDP? What is the document which you had followed to enable HS2 UI? Can you share me the screenshot of the error you are facing Do you have kerberos enabled in your cluster?
... View more
08-12-2021
01:44 AM
Hi @ryu [root@test02 ~]# hdfs dfs -rmr /tmp/root/testdirectory ... ... 21/08/11 12:08:30 WARN fs.TrashPolicyDefault: Can't create trash directory: hdfs://test/user/root/.Trash/Current/tmp/root ... ... rmr: Failed to move to trash: hdfs://test/tmp/root/testdirectory: Permission denied: user=root, access=WRITE, inode="/user":hdfs:hdfs:drwxr-xr-x Upon checking the logs you are trying to delete a testdirectory and if you do that it will try to move the file to trash directory(since trash is enabled) under "/user/root/.Trash" location. Since the folder /user("inode="/user":hdfs:hdfs:drwxr-xr-x") has hdfs as primary and group so eventually the user root falls under others(that is the third one r-x). The other users does not have write permission so that he was not able to write. Either give write permission for user root in to the folder or try to delete the folder as hdfs user to overcome the issue. If you are happy with the reply, mark it Accept as Solution
... View more
08-10-2021
10:33 PM
Hi @Nil_kharat Question: Can anyone tell me how to check how many users are connected to the hive server2? Answer: Login to the server where hiveserver2 is running and run the below command to figure out the number of connections to the HS2 # netstat -ntpl | grep 10000 In the above command 10000 is the HS2 port number You can also check this from Cloudera manager CM > Hive_on_Tez > Instances > HiveServer2 > Open Connections And along with can we see which user is connected? If you enable Hiveserver2 UI then under Active Sessions you can see which user connected from which IP. Please check the below link. https://cwiki.apache.org/confluence/display/Hive/Setting+Up+HiveServer2#SettingUpHiveServer2-WebUIforHiveServer2 If you are happy with the answer, mark it Accept as solution
... View more
06-26-2021
09:40 AM
1 Kudo
Hi @PURUSHOTHAMAN_S I can see there are a lot of alerts(28) in Ambari, if I were you I will start checking with HDFS service at first like namenode are up and running because it is vital for other services to come up. Then you may need to check YARN and then you can concentrate on others. Check out the Ambari startup logs to see why and where it is getting failed. Hope it helps.
... View more
06-20-2021
06:55 AM
@Bryan_zh I believe HDP 3.1.5 supports Spark 2.X only. Please check the below link https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/spark-overview/content/analyzing_data_with_apache_spark.html How to integrate Hive and Spark? https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.0.1/integrating-hive/content/hive_hivewarehouseconnector_for_handling_apache_spark_data.html
... View more
06-20-2021
06:16 AM
Hello @vidanimegh Error: Error while compiling statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Application application_1623850591633_0042 failed 2 times due to AM Container for appattempt_1623850591633_0042_000002 exited with exitCode: -104
Failing this attempt.Diagnostics: [2021-06-18 18:32:52.722]Container [pid=32822,containerID=container_e49_1623850591633_0042_02_000001] is running 34230272B beyond the 'PHYSICAL' memory limit. Current usage: 2.0 GB of 2 GB physical memory used; 3.9 GB of 4.2 GB virtual memory used. Killing container. As I can see your jobs are getting failed with PHYSICAL memory limit error. Could you set the below property in beeline session level and re-run the analysis query and see how it goes. set hive.tez.container.size=8192; set hive.tez.java.opts=-Xmx6553; set tez.runtime.io.sort.mb=3072; set tez.task.resource.memory.mb=8192; set tez.am.resource.memory.mb=8192; set tez.am.launch.cmd-opts=-Xmx6553m;
... View more
06-19-2021
11:36 PM
Hello @Bryan_zh Hive 3 is the default version in HDP 3.1.5 and you cannot degrade the version to Hive 2.3.7. It is also not recommended to degrade Hive from 3.X to 2.X
... View more
05-16-2021
09:56 AM
Hello @bsaad 1. Could you check whether you are able to connect to internet from the Oracle VM, using a ping test to google.com 2. Could you cross-check the port number 8889 is up and listening by using the following command as the root user #netstat -ntpla | grep 8889
... View more
- « Previous
- Next »