Member since
03-23-2015
1288
Posts
114
Kudos Received
98
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3295 | 06-11-2020 02:45 PM | |
5013 | 05-01-2020 12:23 AM | |
2815 | 04-21-2020 03:38 PM | |
2619 | 04-14-2020 12:26 AM | |
2316 | 02-27-2020 05:51 PM |
04-03-2017
11:54 PM
Hmm, sorry, I just noticed that you are running hive CLI, not using beeline, and you do not have HiveServer2 running in the cluster. I will think further what else to check. Will update later on the thread.
... View more
04-03-2017
10:50 PM
4479 was the PID for "grep", not for HS2. I can see that you were running it on your Desktop, can you please run this command on the HiveServer2 host instead?
... View more
04-03-2017
04:47 AM
The best way is to let the query finish, collect the PROFILE output of this query to study which part of the query takes long, what kind of plan was generated etc. Please paste the PROFILE output here.
... View more
04-03-2017
04:45 AM
Can you please get the following info: 1. ps aux | grep HiveServer2 this is to capture the PID for HS2 2. strings /proc/<PID>/environ and paste the output of step 2 here for review. I would like to check what kind of JARs were loaded by HS2.
... View more
03-31-2017
03:41 AM
1 Kudo
Try to run the following Hive query: ALTER TABLE <table_name> SET SERDEPROPERTIES ("timestamp.formats"="yyyy-MM-dd'T'HH:mm:ss.SSSZ"); Then SELECT the table again should work. This was introduced as part of: https://issues.apache.org/jira/browse/HIVE-9298
... View more
03-31-2017
03:18 AM
Can you please run the following command: beeline -u 'jdbc:hive2://localhost:10000/default' -n hive will this also fail? What does CM tell you the HiveServer2 status? Is it green? Any log messages generated under /var/log/hive directory?
... View more
03-31-2017
03:11 AM
In that case, my suggestion is to check for HS2 logs to try to find any queries that takes time to compile. Because HS2 currently can only compile one query at a time, if you have a query that takes a while to compile, it will lock out HS2 and other requests will have to wait. I am not sure if it is the cause, but worth to check the HS2 log. Look for the following example: Completed compiling command(queryId=hive_20170227192424_ee0c5216-bef5-456a-934e-212aabe55b75); Time taken: 0.191 seconds and check if any Time taken values are too big around the time when issue happens.
... View more
03-31-2017
02:57 AM
Hi ,
The error message suggested that HS2 was not running, have you confirmed by connecting from beeline to make sure that you can run queries through the HS2?
... View more
03-23-2017
04:13 AM
1 Kudo
Try to go to: CM > Hive > Configuration > search for "Hive Service Environment Advanced Configuration Snippet (Safety Valve)" and put in environment settings you want to update here. Cloudera Manager will then ask you to restart Hive service. This will affect both HS2 and HMS.
... View more
03-07-2017
02:25 AM
I can see that from JDBC: Start Time: 2017-03-03 11:38:07.269796000
End Time: 2017-03-03 11:38:08.508511000 Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
----------------------------------------------------------------------------------------------------------------------
01:EXCHANGE 1 0.000ns 0.000ns 1 1 0 -1.00 B UNPARTITIONED
00:SCAN HDFS 1 17.999ms 17.999ms 1 1 1.56 MB 768.00 MB default.impala_table
and from impala-shell Start Time: 2017-03-03 11:40:15.660573000
End Time: 2017-03-03 11:40:15.806061000 Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
----------------------------------------------------------------------------------------------------------------------
01:EXCHANGE 1 0.000ns 0.000ns 1 1 0 -1.00 B UNPARTITIONED
00:SCAN HDFS 1 23.999ms 23.999ms 1 1 1.56 MB 768.00 MB default.impala_table I don't see major differences here, though from JDBC in total it took just above 1 second and through impala-shell in total well below 1 second. What was the main difference in time from JDBC connection start to finish? Queries will definitely have some overhead when running through JDBC since it is from outside of cluster. You can find more details from the TRACE log you collected.
... View more