Member since
09-29-2015
40
Posts
12
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
718 | 08-15-2016 08:32 PM | |
19392 | 07-02-2016 04:35 PM | |
1741 | 06-21-2016 11:43 PM | |
478 | 06-06-2016 04:46 PM | |
1635 | 05-16-2016 11:09 PM |
08-15-2016
08:32 PM
1 Kudo
@cduby In order to use LLAP, you should connect to Hive2 HiveServer2. However, based on the jdbc url, it seems you are connecting to Hive1 HiveServer2. That's probably why you get the error, 'hive.llap.execution.mode variable does not exist'. Hive2 HiveServer2 port is typically 10500. You should figure out the Hive2 HiveServer2 host (whether it is localhost), get the correct jdbc url and connect to Hive2 HiveServer2 with the jdbc url.
... View more
07-28-2016
10:54 PM
Hi @Girish Chaudhari Thanks for the stack trace. Now we know why it failed. It's because the container cannot be launched because default_container_executor_session.sh doesn't exist at /mnt/resource/usercache/girish/appcache/application_1466711437570_0051/container_e02_1466711437570_0051_02_000001 As to why this happened, that still needs to be investigated. Will update if I find something.
... View more
07-27-2016
11:17 PM
Hi @Girish Chaudhari It's hard to tell what the root cause is based on the above error. Can you provide yarn application log? You can get it by running 'yarn logs -applicationId [your application_id]'
... View more
07-02-2016
04:35 PM
1 Kudo
Hi @Parinita Kothari, I tried with hive ver. 1.2.1 and I couldn't reproduce your issue as shown in the below. What version of hive are you using? hive> set hive.support.concurrency=true;
hive> set hive.enforce.bucketing=true;
hive> set hive.exec.dynamic.partition.mode=nonstrict;
hive> set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
hive> set hive.compactor.initiator.on=true;
hive> create table test_decimal(i int, time_key DECIMAL(38,2)) clustered by (TIME_KEY) into 16 buckets stored as orc TBLPROPERTIES ('transactional' = 'true');
OK
Time taken: 0.557 seconds
hive> insert into table test_decimal values(1, 15.56);
Query ID = hrt_qa_20160702163059_7e2c279f-158e-4477-9123-357db69075b9
Total jobs = 1
Launching Job 1 out of 1
Status: Running (Executing on YARN cluster with App id application_1467208466253_0268)
--------------------------------------------------------------------------------
VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
--------------------------------------------------------------------------------
Map 1 .......... SUCCEEDED 1 1 0 0 0 0
Reducer 2 ...... SUCCEEDED 16 16 0 0 0 0
--------------------------------------------------------------------------------
VERTICES: 02/02 [==========================>>] 100% ELAPSED TIME: 44.74 s
--------------------------------------------------------------------------------
Loading data to table default.test_decimal
Table default.test_decimal stats: [numFiles=1, numRows=1, totalSize=655, rawDataSize=0]
OK
Time taken: 49.152 seconds
hive> select * from test_decimal;
OK
115.56
Time taken: 0.282 seconds, Fetched: 1 row(s)
... View more
06-30-2016
05:41 PM
Hi @suresh krish As @Rajkumar Singh advised, that parameter cannot be modified at runtime. That means you have to modify that in hive-site.xml and restart HiveServer2. Then the change should be in effect when you connect to HS2 via beeline.
... View more
06-29-2016
03:17 PM
Hi @Shihab In addition to what @vpoornalingam suggested in the above, does restarting hive metastore help? If not, you can also take a look at hive metastore log which is located in hive host to see if any error is being thrown.
... View more
06-21-2016
11:43 PM
4 Kudos
@Rich Raposa When you start hive cli, it starts a yarn application, which can be viewed via resource manager UI. When you 'exit', you finish the application. And when you starts hive cli again, it starts another yarn application. But when you do Ctrl+c, that does not finish the application although that application eventually times out. While that previous application still hangs around and when you start CLI again anyway, it try to start a new app, but there is probably not enough capacity because of the previous application. When that previous application eventually times out, a new application start running and that's when you can use Hive CLI again.
... View more
06-07-2016
04:38 AM
You can use HDFS ACLS: http://hortonworks.com/hadoop-tutorial/fine-grained-permissions-hdfs-files-hadoop-using-hdfs-acls/ And if you are using Hive, you can use storage based authorization as hive.security.authorization.manager in hive-site.xml, which uses HDFS ACL as permission to hive tables/databases.
... View more
06-06-2016
04:46 PM
Hi Sankar, Are you using HDP cluster? If so, you can take an advantage of Ranger, which allow you to grant different permission to different users. You can lean more about Ranger via http://hortonworks.com/apache/ranger/
... View more
06-05-2016
03:30 PM
There was a known issue with empty partitions/files/tables: https://issues.apache.org/jira/browse/HIVE-13394 Is your case such a case?
... View more
06-02-2016
05:13 AM
Hi Antonio Arfe Can you connect to HiveServer2 via beeline with your connection string? If you can, the error may suggest that an yarn app is not starting for some reason. You can verify that by visiting resource manager UI.
... View more
05-27-2016
12:38 AM
I see you are using constant value for partition column. You might be hitting this issue: https://issues.apache.org/jira/browse/HIVE-12893
... View more
05-17-2016
09:56 PM
Just curious. How did you conclude that it is a permission issue: The error shows that "Unable to move sourcehdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/cards.db/categories/part-m-00000.gz to destinationhdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/cards.db/categories/part-m-00000.gz FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask" That says nothing about permission. Did you take a look at yarn app log?
... View more
05-16-2016
11:09 PM
If you enable yarn.acl.enable, you can use an user defined by yarn.admin.acl to kill the application.
... View more
05-10-2016
09:15 PM
you may want to set tez.session.client.timeout.secs to something like 180 other than -1 because -1 means it waits forever. Also you may want to look into the application log to investigate why that job is being stuck.
... View more
05-09-2016
11:40 PM
It's not the ultimate solution, but you can reduce tez.session.am.dag.submit.timeout.secs to avoid job from being hold up for a long time.
... View more
05-09-2016
06:04 PM
1 Kudo
Not for ranger, but for hive, you can remove password from hive-site.xml by following the below: https://cwiki.apache.org/confluence/display/Hive/AdminManual+Configuration
... View more
03-14-2016
05:34 PM
Can you use ESCAPED BY '\' when you create an ORC table and load from the external table?
... View more
01-19-2016
07:43 PM
Ambari may be running some shell script to check if Hive service is running. Can you tell which shell scrip is running from the stack trace? Also can you run 'create table' and 'drop table' via Hive CLI? If you can, the error you are facing might be due to a bug in that shell script that Ambari is running.
... View more
01-18-2016
06:01 PM
I may be able to provide analysis if you can post any error in hive server2 log. First thing is to check if hive server2 is up and running properly.
... View more
11-10-2015
06:09 PM
1 Kudo
/usr/hdp/current/hive-client/bin/beeline -n hrt_qa -p pwd -u "jdbc:hive2://host:2181,host2:2181,host3:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2" --outputformat=tsv -f /grid/0/hadoopqe/artifacts/tmp-820871
... View more