Member since
02-16-2017
45
Posts
2
Kudos Received
0
Solutions
07-17-2019
11:05 AM
Which version of HDP are you using ?
... View more
11-14-2017
03:47 PM
1 Kudo
@Stefan Kupstaitis-Dunkler I never said I used hive CLI to connect to LLAP. I am connecting through beeline, we can give the username when we connect to LLAP through beeline and make it run through the (end)user through which we login to a beeline session. I have no issues regarding connecting to hiveserver2 or LLAP. I just want someone from hortonworks development team to acknowledge that we cannot have impersonation using LLAP.
... View more
11-10-2017
07:52 PM
@Stefan Kupstaitis-Dunkler If I do not set hive.server2.enable.doAs=true in hive-interactive section(even if I set hive.server2.enable.doAs=true in hive main config page), It runs all my queries as hive user in LLAP and end user in hive CLI. That means I clearly cannot have impersonation enabled in LLAP until I set hive.server2.enable.doAs=true in hive-interactive section. And as you said if I set it to true it wont make sense from resource point of view. Thus there is clearly a conflict between running LLAP and Impersonation, In other words we cannot have impersonation in LLAP.
... View more
11-09-2017
06:53 PM
Hello @Stefan Kupstaitis-Dunkler Well. It does not seem to simply ignore it. The property hive.server2.enable.doAs is there in two places in Ambari,One in config-settings page of hive and other in advanced page(which belongs to Hive-Interactive server or LLAP). Yes you are right it ignores it if you set this property for hive,but if you set this property for LLAP it definitely takes effect(I tested by creating a table through LLAP and it creates it with end user). I do not think LLAP daemons are down or crashing. I can monitor all my LLAP daemons and I also checked the status of LLAP,its in RUNNING_ALL state. If I just turn off this property everything runs normal on LLAP. We cannot run any query which starts mappers on LLAP if this property is set. I can connect to LLAP and run simple queries which doesn't start a mapper like select * or create. But if I start any query which requires a mapper it fails with the above error. I am assuming LLAP has a problem sharing its resources with multiple users. The error it is showing seems to be misdirecting. @Stefan Kupstaitis-Dunkler can you please confirm if you are able to run mappers under LLAP by setting this property hive.server2.enable.doAs=true in Advanced hive-interactive site section
... View more
11-06-2017
05:35 PM
I find that the jobs in LLAP are failing when I enable the property run as end user instead of hive user.I get the below error. [Code: 2, SQL
State: 08S01] Error while processing statement: FAILED: Execution Error,
return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed,
vertexName=Map 1, vertexId=vertex_1507231420401_0045_1_00, diagnostics=[Vertex
vertex_1507231420401_0045_1_00 [Map 1] killed/failed due to:INIT_FAILURE, Fail
to create InputInitializerManager,
org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with
1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator Caused by:
java.lang.reflect.InvocationTargetException at
sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at
java.lang.reflect.Constructor.newInstance(Constructor.java:423) at
org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:68) ... 25 more Caused by: java.lang.IllegalArgumentException:
No running LLAP daemons! Please check LLAP service status and zookeeper
configuration Does LLAP have any issue with this property being enabled? I could run the query on LLAP if I run it as hive user.
... View more
Labels:
- Labels:
-
Apache Hive
11-02-2017
04:42 PM
1 Kudo
Can I run multiple Hive Interactive servers running on different LLAP queues on a cluster(HDP 2.6.2). Right now I am only able to run single Hive interactive server through ambari by enabling hive interactive query. Is there any documentation which shows having multiple Hive LLAP connections on my cluster
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
10-16-2017
08:14 PM
One more thing.When I issue show locks <table> command. I can only see exclusive locks being shown for insert queries but it is not showing shared locks on select queries ?
... View more
10-16-2017
05:37 PM
I am running a select query with where condition picking the partition which is not been inserted. Now the select query is not supposed to run over all partitions. But still the select query waits for the insert(into static partition) to be finished.
... View more
10-16-2017
05:26 PM
I am not running the select query on the whole table. I am running select query with where clause filtering a single partition which is not been updated. It still waits for the insert to be finished even if the partition its inserting is not an existing one.
... View more
10-13-2017
03:28 PM
I am doing an insert overwrite on a partition(static) which takes a few minutes to finish. I want to still query the same table with select command when am doing the insert. But the select query does not start running until the insert query finishes . I know the insert query gets an exclusive lock on just the partition I am writing to .I am trying to figure out why the select query is not able to just read all other partitions on which it can acquire a lock on
... View more
Labels:
- Labels:
-
Apache Hive