Member since
09-29-2015
40
Posts
12
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1807 | 08-15-2016 08:32 PM | |
27868 | 07-02-2016 04:35 PM | |
4097 | 06-21-2016 11:43 PM | |
1627 | 06-06-2016 04:46 PM | |
3452 | 05-16-2016 11:09 PM |
08-15-2016
08:32 PM
1 Kudo
@cduby In order to use LLAP, you should connect to Hive2 HiveServer2. However, based on the jdbc url, it seems you are connecting to Hive1 HiveServer2. That's probably why you get the error, 'hive.llap.execution.mode variable does not exist'. Hive2 HiveServer2 port is typically 10500. You should figure out the Hive2 HiveServer2 host (whether it is localhost), get the correct jdbc url and connect to Hive2 HiveServer2 with the jdbc url.
... View more
07-28-2016
10:54 PM
Hi @Girish Chaudhari Thanks for the stack trace. Now we know why it failed. It's because the container cannot be launched because default_container_executor_session.sh doesn't exist at /mnt/resource/usercache/girish/appcache/application_1466711437570_0051/container_e02_1466711437570_0051_02_000001 As to why this happened, that still needs to be investigated. Will update if I find something.
... View more
07-27-2016
11:17 PM
Hi @Girish Chaudhari It's hard to tell what the root cause is based on the above error. Can you provide yarn application log? You can get it by running 'yarn logs -applicationId [your application_id]'
... View more
07-02-2016
04:35 PM
1 Kudo
Hi @Parinita Kothari, I tried with hive ver. 1.2.1 and I couldn't reproduce your issue as shown in the below. What version of hive are you using? hive> set hive.support.concurrency=true;
hive> set hive.enforce.bucketing=true;
hive> set hive.exec.dynamic.partition.mode=nonstrict;
hive> set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
hive> set hive.compactor.initiator.on=true;
hive> create table test_decimal(i int, time_key DECIMAL(38,2)) clustered by (TIME_KEY) into 16 buckets stored as orc TBLPROPERTIES ('transactional' = 'true');
OK
Time taken: 0.557 seconds
hive> insert into table test_decimal values(1, 15.56);
Query ID = hrt_qa_20160702163059_7e2c279f-158e-4477-9123-357db69075b9
Total jobs = 1
Launching Job 1 out of 1
Status: Running (Executing on YARN cluster with App id application_1467208466253_0268)
--------------------------------------------------------------------------------
VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
--------------------------------------------------------------------------------
Map 1 .......... SUCCEEDED 1 1 0 0 0 0
Reducer 2 ...... SUCCEEDED 16 16 0 0 0 0
--------------------------------------------------------------------------------
VERTICES: 02/02 [==========================>>] 100% ELAPSED TIME: 44.74 s
--------------------------------------------------------------------------------
Loading data to table default.test_decimal
Table default.test_decimal stats: [numFiles=1, numRows=1, totalSize=655, rawDataSize=0]
OK
Time taken: 49.152 seconds
hive> select * from test_decimal;
OK
115.56
Time taken: 0.282 seconds, Fetched: 1 row(s)
... View more
06-30-2016
05:41 PM
Hi @suresh krish As @Rajkumar Singh advised, that parameter cannot be modified at runtime. That means you have to modify that in hive-site.xml and restart HiveServer2. Then the change should be in effect when you connect to HS2 via beeline.
... View more
06-29-2016
03:17 PM
Hi @Shihab In addition to what @vpoornalingam suggested in the above, does restarting hive metastore help? If not, you can also take a look at hive metastore log which is located in hive host to see if any error is being thrown.
... View more
06-21-2016
11:43 PM
4 Kudos
@Rich Raposa When you start hive cli, it starts a yarn application, which can be viewed via resource manager UI. When you 'exit', you finish the application. And when you starts hive cli again, it starts another yarn application. But when you do Ctrl+c, that does not finish the application although that application eventually times out. While that previous application still hangs around and when you start CLI again anyway, it try to start a new app, but there is probably not enough capacity because of the previous application. When that previous application eventually times out, a new application start running and that's when you can use Hive CLI again.
... View more
06-07-2016
04:38 AM
You can use HDFS ACLS: http://hortonworks.com/hadoop-tutorial/fine-grained-permissions-hdfs-files-hadoop-using-hdfs-acls/ And if you are using Hive, you can use storage based authorization as hive.security.authorization.manager in hive-site.xml, which uses HDFS ACL as permission to hive tables/databases.
... View more
06-06-2016
04:46 PM
Hi Sankar, Are you using HDP cluster? If so, you can take an advantage of Ranger, which allow you to grant different permission to different users. You can lean more about Ranger via http://hortonworks.com/apache/ranger/
... View more