Member since
03-02-2021
43
Posts
1
Kudos Received
0
Solutions
06-02-2021
03:54 AM
@Shelton If I try to use hdfs.headless.keytab = [hive@server-hdp ~]$ kinit -kt /etc/security/keytabs/hdfs.headless.keytab
kinit: Client 'host/server-hdp.mydomain.com@MYDOMAIN.COM' not found in Kerberos database while getting initial credentials
[hive@server-hdp ~]$ klist
klist: No credentials cache found (filename: /tmp/krb5cc_1001)
[hive@server-hdp ~]$
... View more
06-02-2021
03:44 AM
@Shelton Thanks for the reply. I confirmed that it's HS2 listed in hadoop.proxyuser.hive.hosts i.e. slave2 host in my case which is running Hive server service by now.
... View more
06-02-2021
03:26 AM
@Shelton wrote: [konar@simba ~]$ kinit -kt konar.keytab konar@KENYA.KE The above should throw any error Now validate the user has a valid ticket [konar@simba ~]$ klist Ticket cache: FILE:/tmp/krb5cc_1024 Default principal: konar@KENYA.KE Valid starting Expires Service principal 08/25/2019 18:53:40 08/26/2019 18:53:40 krbtgt/KENYA.KE@KENYA.KE Bravo you have a valid ticket and hence access to the cluster let's validate that the below HDFS list directory should succeed I am getting following error after executing kinit -kt command for hive user = [hive@server-hdp ~]$ kinit -kt hive.keytab hive@MYDOMAIN.COM kinit: Password incorrect while getting initial credentials Pls suggest how to solve this issue thanks. My krb5.conf = [hive@server-hdp ~]$ cat /etc/krb5.conf
[libdefaults]
#renew_lifetime = 7d
forwardable = true
default_realm = MYDOMAIN.COM
ticket_lifetime = 24h
dns_lookup_realm = false
dns_lookup_kdc = false
default_ccache_name = /tmp/krb5cc_%{uid}
#default_tgs_enctypes = aes des3-cbc-sha1 rc4 des-cbc-md5
#default_tkt_enctypes = aes des3-cbc-sha1 rc4 des-cbc-md5
[domain_realm]
mydomain.com = MYDOMAIN.COM
[logging]
default = FILE:/var/log/krb5kdc.log
admin_server = FILE:/var/log/kadmind.log
kdc = FILE:/var/log/krb5kdc.log
[realms]
MYDOMAIN.COM = {
admin_server = server-hdp.mydomain.com
kdc = server-hdp.mydomain.com
} keytab works for user1 & user1 can access hdfs without any issue. Regards, Amey.
... View more
06-01-2021
03:03 AM
Hello,
I am trying to execute 1 .hql script from Edge node. [hdp-slave4.mydomain.com]
hdp-slave4 machine is not running any server roles i.e. zookeeper or hive. Only having zookeeper & hive clients. HDP version: 3.1.4
Command = hive -f ./dumping_test_script.hql
I am getting following error = INFO : Moving data to local directory /home/user1/user1_Run_Jar/AB_HIVE_1805 2021/neo4j-graph-preparation/data-files/user_stats from hdfs://hdp-master.mydomain .com:8020/tmp/hive/hive/df588c46-4e05-4a5c-8fde-5b7aaf9329a6/hive_2021-06- 01_13-55-09_157_7991483949013764396-29555/-mr-10000 ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.ex ec.MoveTask. Unable to move source hdfs://hdp-master.mydomain.com:8020/tmp/hive/hive/df588c46-4e05-4a5c-8fde-5b7aaf9329a6/hive_2021-06-01_13-55-09_157_79914 83949013764396-29555/-mr-10000 to destination /home/user1/user1_Run_Jar/AB_HIVE_18052021/neo4j-graph-preparation/data-files/user_stats DEBUG : Shutting down query INSERT OVERWRITE LOCAL DIRECTORY '/home/user1/user1 _Run_Jar/AB_HIVE_18052021/neo4j-graph-preparation/data-files/user_stats' ROW FORMAT DELIMITED FIELDS TERMINATED BY '\u001' SELECT type, identifier, product, instance, user_id, app_id FROM user_stats
Any hints how to fix this issue? Thanks.
Regards,
Amey.
... View more
Labels:
05-21-2021
12:24 AM
After moving HIVE to another slave node, HIVE is now working but, If I try to invoke hive shell from slave1 i.e. the problematic host, it tries to connect to the same host i.e. slave1. I compared 'hive-site.xml' of slave1 & slave2. No difference. Some suspect from the hive-site.xml which might causing slave1 to connect to slave1 after invoking hive shell = <property>
<name>atlas.rest.address</name>
<value>http://hdp-slave1.mydomain.com:21000</value>
</property>
<property>
<name>hive.cluster.delegation.token.store.zookeeper.connectString</name>
<value>hdp-slave1.mydomain.com:2181,hdp-slave2.mydomain.com:2181,hdp-master.mydomain.com:2181</value>
</property>
<property>
<name>hive.zookeeper.quorum</name>
<value>hdp-slave1.mydomain.com:2181,hdp-slave2.mydomain.com:2181,hdp-master.mydomain.com:2181</value>
</property>
... View more
05-20-2021
05:27 AM
@tusharkathpal Thanks. zookeeper logs aren't showing any useful info I think = 2021-05-20 17:51:09,093 - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2021-05-20 17:51:09,094 - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2021-05-20 17:51:09,094 - INFO [main:Environment@100] - Client environment:java.compiler=<NA>
2021-05-20 17:51:09,094 - INFO [main:Environment@100] - Client environment:os.name=Linux
2021-05-20 17:51:09,094 - INFO [main:Environment@100] - Client environment:os.arch=amd64
2021-05-20 17:51:09,094 - INFO [main:Environment@100] - Client environment:os.version=3.10.0-1127.19.1.el7.x86_64
2021-05-20 17:51:09,094 - INFO [main:Environment@100] - Client environment:user.name=root
2021-05-20 17:51:09,094 - INFO [main:Environment@100] - Client environment:user.home=/root
2021-05-20 17:51:09,094 - INFO [main:Environment@100] - Client environment:user.dir=/var/lib/ambari-agent
2021-05-20 17:51:09,095 - INFO [main:ZooKeeper@438] - Initiating client connection, connectString=hdp-master.mydomain.com:2181,hdp-slave2.mydomain.com:2181,hdp-slave1.mydomain.com:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@25f38edc
2021-05-20 17:51:09,120 - INFO [main-SendThread(hdp-master.mydomain.com:2181):ClientCnxn$SendThread@1013] - Opening socket connection to server hdp-master.mydomain.com/10.200.104.187:2181. Will not attempt to authenticate using SASL (unknown error)
2021-05-20 17:51:09,190 - INFO [main-SendThread(hdp-master.mydomain.com:2181):ClientCnxn$SendThread@856] - Socket connection established, initiating session, client: /10.200.104.188:37684, server: hdp-master.mydomain.com/10.200.104.187:2181
2021-05-20 17:51:09,211 - INFO [main-SendThread(hdp-master.mydomain.com:2181):ClientCnxn$SendThread@1273] - Session establishment complete on server hdp-master.mydomain.com/10.200.104.187:2181, sessionid = 0x17988299eff0059, negotiated timeout = 30000
2021-05-20 17:51:19,799 - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.6-315--1, built on 08/23/2019 05:02 GMT
2021-05-20 17:51:19,801 - INFO [main:Environment@100] - Client environment:host.name=hdp-slave1.mydomain.com
2021-05-20 17:51:19,801 - INFO [main:Environment@100] - Client environment:java.version=1.8.0_262
2021-05-20 17:51:19,804 - INFO [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2021-05-20 17:51:19,804 - INFO [main:Environment@100] - Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.262.b10-0.el7_8.x86_64/jre
2021-05-20 17:51:19,804 - INFO [main:Environment@100] - Client environment:java.class.path=/usr/hdp/current/zookeeper-client/bin/../build/classes:/usr/hdp/current/zookeeper-client/bin/../build/lib/*.jar:/usr/hdp/current/zookeeper-client/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/hdp/current/zookeeper-client/bin/../lib/slf4j-api-1.6.1.jar:/usr/hdp/current/zookeeper-client/bin/../lib/netty-3.10.5.Final.jar:/usr/hdp/current/zookeeper-client/bin/../lib/log4j-1.2.16.jar:/usr/hdp/current/zookeeper-client/bin/../lib/jline-0.9.94.jar:/usr/hdp/current/zookeeper-client/bin/../zookeeper-3.4.6.3.1.4.0-315.jar:/usr/hdp/current/zookeeper-client/bin/../src/java/lib/*.jar:/usr/hdp/current/zookeeper-client/bin/../conf::/usr/share/zookeeper/*
... View more
05-20-2021
02:00 AM
@Shelton Tried the commands. Output = [zk: localhost:2181(CONNECTED) 0] ls /hiveserver2
[]
[zk: localhost:2181(CONNECTED) 1] Metastore for Hive is MySQL in my case. Can you pls suggest further steps to fix the issue? Thanks. Hive is unable to start on my HDP 3.1.4 cluster. Regards, Amey.
... View more
05-20-2021
12:32 AM
Hello, I am getting following error when trying to start Hive server = 2021-05-20 12:21:50,088 - Will retry 7 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s)
2021-05-20 12:22:00,098 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hdp-master.mydomain.com:2181,hdp-slave2.mydomain.com:2181,hdp-slave1.mydomain.com:2181 ls /hiveserver2 | grep 'serverUri=''] {}
2021-05-20 12:22:00,780 - call returned (1, '')
2021-05-20 12:22:00,781 - Will retry 6 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s)
2021-05-20 12:22:10,791 - Process with pid 12962 is not running. Stale pid file at /var/run/hive/hive-server.pid I referred to similar threads at this forum but didn't help. Pls suggest how to fix this issue thank you. Regards, Amey.
... View more
Labels:
- Labels:
-
Apache Hive
04-28-2021
12:28 AM
Hi @shobikas, Thanks for your response. I tried running queries using the configs you mentioned. Queries are getting executed successfully but no change is observed in table data. Following queries I'm running in hive (for mix partitioning which includes static and dynamic partitioning together) 1. insert into table foodmart.idNameGenderPartDeptTableName partition (manager_id = 200, manager_name, manager_gender) VALUES (1, 'COMP', 'John', 'M'); 2. insert into table foodmart.idNameGenderPartDeptTableName partition (manager_id = 1111, manager_name, manager_gender) select department_id, full_name, first_name, gender from foodmart.trimmed_employee; 3. insert OVERWRITE table foodmart.idNameGenderPartDeptTableName partition (manager_id = 1234, manager_name, manager_gender) select department_id, full_name, first_name, gender from foodmart.trimmed_employee; 4. insert OVERWRITE table foodmart.idNameGenderPartDeptTableName partition (manager_id = 1234, manager_name, manager_gender) values (02, 'HR', 'Niks', 'M');
... View more
04-26-2021
02:46 AM
Error message: Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask (state=08S01,code=1) Following is Details of our cluster HDP Version: 3.1.4 Hive Version: 3.1.0.3.1.4.0-315 Configs for Dynamic Partition in hive: hive.exec.dynamic.partition=true Allow all partitions to be Dynamic=nonstrict hive.exec.max.dynamic.partitions=50000 hive.exec.max.dynamic.partitions.pernode=20000 Sort Partitions Dynamically=false Allow dynamic numbers of reducers=true Allow dynamic partition pruning=true Any help appreciated.
... View more
Labels:
- Labels:
-
Apache Hive
- « Previous
- Next »