Member since
β10-25-2018
9
Posts
0
Kudos Received
0
Solutions
β10-30-2018
10:22 AM
Hi @BjΓΆrn List, Thank you so much π By the way, I found that Accumulo was in the same port of Hive, so I disabled The first one to run hiveserver2. Best regards, Ayoub
... View more
β10-30-2018
12:32 AM
Hello @BjΓΆrn List, I'm facing the same problem for an emergency situation. Can you show me please how to find the right port to set instead of "10002" ? Which port should we put ? Thank you in advance π
... View more
β10-29-2018
03:49 PM
Hi @Gangadhar Kadam, Can you please help me with this error ? I'm still nor resolving it, and it's an emergency for me. That's my hiveserver2 properties from hive-site.xml. Thank you in advance π
... View more
β10-26-2018
01:40 PM
@Jay Kumar SenSharma, I remarked a weird behavior from hiveserver2. When I use the command manually, the HS2 starts and change its status to 'running' (when I do it from the ambari interface it doesn't run). However, once I start hive from my terminal, the HS2 service stops again. Do you have any idea please ? Thank you π
... View more
β10-26-2018
12:28 PM
Hi @Jay Kumar SenSharma, I fixed the host error, and now when I execute the command you gave me by adding (') in the end, it works well without returning any output. However, If I execute it as you wrote it, it returns the result given below : Connecting to XXXXXXXXXXXXXX:2181
2018-10-26 09:29:29,163 - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.6-187--1, built on 09/19/2018 10:36 GMT
2018-10-26 09:29:29,165 - INFO [main:Environment@100] - Client environment:host.name=XXXXXXXXXXXXXX
2018-10-26 09:29:29,165 - INFO [main:Environment@100] - Client environment:java.version=1.8.0_112
2018-10-26 09:29:29,167 - INFO [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2018-10-26 09:29:29,167 - INFO [main:Environment@100] - Client environment:java.home=/usr/jdk64/jdk1.8.0_112/jre
2018-10-26 09:29:29,167 - INFO [main:Environment@100] - Client environment:java.class.path=/usr/hdp/current/zookeeper-client/bin/../build/classes:/usr/hdp/current/
zookeeper-client/bin/../build/lib/*.jar:/usr/hdp/current/zookeeper-client/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/hdp/current/zookeeper-client/bin/../lib/slf4j-api-
1.6.1.jar:/usr/hdp/current/zookeeper-client/bin/../lib/netty-3.10.5.Final.jar:/usr/hdp/current/zookeeper-client/bin/../lib/log4j-1.2.16.jar:/usr/hdp/current/zookeep
er-client/bin/../lib/jline-0.9.94.jar:/usr/hdp/current/zookeeper-client/bin/../zookeeper-3.4.6.3.0.1.0-187.jar:/usr/hdp/current/zookeeper-client/bin/../src/java/lib
/*.jar:/usr/hdp/current/zookeeper-client/bin/../conf::/usr/share/zookeeper/*
2018-10-26 09:29:29,167 - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2018-10-26 09:29:29,167 - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2018-10-26 09:29:29,167 - INFO [main:Environment@100] - Client environment:java.compiler=<NA>
2018-10-26 09:29:29,168 - INFO [main:Environment@100] - Client environment:os.name=Linux
2018-10-26 09:29:29,168 - INFO [main:Environment@100] - Client environment:os.arch=amd64
2018-10-26 09:29:29,168 - INFO [main:Environment@100] - Client environment:os.version=4.15.0-1023-gcp
2018-10-26 09:29:29,168 - INFO [main:Environment@100] - Client environment:user.name=root
2018-10-26 09:29:29,168 - INFO [main:Environment@100] - Client environment:user.home=/root
2018-10-26 09:29:29,168 - INFO [main:Environment@100] - Client environment:user.dir=/root
2018-10-26 09:29:29,169 - INFO [main:ZooKeeper@438] - Initiating client connection, connectString=XXXXXXXXXXXXXX
:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@67424e82
2018-10-26 09:29:29,190 - INFO [main-SendThread(XXXXXXXXXXXXXX:2181):ClientCnxn$SendThread@1019] - Opening socke
t connection to server XXXXXXXXXXXXXX/XX.XXX.X.X:2181. Will not attempt to authenticate using SASL (unknown error
)
2018-10-26 09:29:29,256 - INFO [main-SendThread(XXXXXXXXXXXXXX:2181):ClientCnxn$SendThread@864] - Socket connect
ion established, initiating session, client: /XX.XXX.X.X:37962, server: XXXXXXXXXXXXXX/XX.XXX.X.X:2181
2018-10-26 09:29:29,263 - INFO [main-SendThread(XXXXXXXXXXXXXX:2181):ClientCnxn$SendThread@1279] - Session estab
lishment complete on server XXXXXXXXXXXXXX/XX.XXX.X.X:2181, sessionid = 0x166ab69786a01a1, negotiated timeout = 3
0000
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
[] Can please detect anything wrong ? Thanks in advance π
... View more
β10-26-2018
08:43 AM
Thank you @Jay Kumar SenSharma for your reply.
I think there is something to add in "serverUri=' ' ? So the command can't run and returning : Exception in thread "main" java.lang.IllegalArgumentException: A HostProvider may not be empty! Also, when I check Zookeeper service in my Ambari interface it's working and running very well (I restart it and still running properly). Thank you in advance π
... View more
β10-25-2018
11:08 PM
HI @Gangadhar Kadam, Thank you so much for your reply. I got the same issue even if I make hive.metastore.uris=' ' in my Hive configs. You find below the hiveserve2 properties : <property>
<name>hive.server2.allow.user.substitution</name>
<value>true</value>
</property>
<property>
<name>hive.server2.authentication</name>
<value>NONE</value>
</property>
<property>
<name>hive.server2.authentication.spnego.keytab</name>
<value>HTTP/_HOST@EXAMPLE.COM</value>
</property>
<property>
<name>hive.server2.authentication.spnego.principal</name>
<value>/etc/security/keytabs/spnego.service.keytab</value>
</property>
<property>
<name>hive.server2.enable.doAs</name>
<value>false</value>
</property>
<property>
<name>hive.server2.idle.operation.timeout</name>
<value>6h</value>
</property>
<property>
<name>hive.server2.idle.session.timeout</name>
<value>1d</value>
</property>
<property>
<name>hive.server2.logging.operation.enabled</name>
<value>true</value>
</property>
<property>
<name>hive.server2.logging.operation.log.location</name>
<value>/tmp/hive/operation_logs</value>
</property>
<property>
<name>hive.server2.max.start.attempts</name>
<value>5</value>
</property>
<property>
<name>hive.server2.support.dynamic.service.discovery</name>
<value>true</value>
</property>
<property>
<name>hive.server2.table.type.mapping</name>
<value>CLASSIC</value>
</property>
<property>
<name>hive.server2.tez.default.queues</name>
<value>default</value>
</property>
<property>
<name>hive.server2.tez.initialize.default.sessions</name>
<value>false</value>
</property>
<property>
<name>hive.server2.tez.sessions.per.default.queue</name>
<value>1</value>
</property>
<property>
<name>hive.server2.thrift.http.path</name>
<value>cliservice</value>
</property>
<property>
<name>hive.server2.thrift.http.port</name>
<value>10001</value>
</property>
<property>
<name>hive.server2.thrift.sasl.qop</name>
<value>auth</value>
</property>
<property>
<name>hive.server2.transport.mode</name>
<value>binary</value>
</property>
<property>
<name>hive.server2.use.SSL</name>
<value>false</value>
</property>
<property>
<name>hive.server2.webui.cors.allowed.headers</name>
<value>X-Requested-With,Content-Type,Accept,Origin,X-Requested-By,x-requested-by</value>
</property>
<property>
<name>hive.server2.webui.enable.cors</name>
<value>true</value>
</property>
<property>
<name>hive.server2.webui.port</name>
<value>10002</value>
</property>
<property>
<name>hive.server2.webui.use.ssl</name>
<value>false</value>
</property>
<property>
<name>hive.server2.zookeeper.namespace</name>
<value>hiveserver2</value>
</property> Thank you in advance π
... View more
β10-25-2018
03:40 PM
Hello @Jay Kumar SenSharma, I'm facing the same issue for an emergency project. I did all these recommanded settings, but the problem is still here. My Hiveserver2 is not running... Given below my issue : 2018-10-25 14:59:40,525 - call['ambari-sudo.sh su hive -l -s /bin/bash -c 'cat /var/run/hive/hive-server.pid 1>/tmp/tmpkgSe4y 2>/tmp/tmpSm8Hzr''] {'quiet': False}
2018-10-25 14:59:40,546 - call returned (1, '')
2018-10-25 14:59:40,546 - Execution of 'cat /var/run/hive/hive-server.pid 1>/tmp/tmpkgSe4y 2>/tmp/tmpSm8Hzr' returned 1. cat: /var/run/hive/hive-server.pid: No such file or directory
2018-10-25 14:59:40,546 - get_user_call_output returned (1, u'', u'cat: /var/run/hive/hive-server.pid: No such file or directory')
2018-10-25 14:59:40,547 - call['ambari-sudo.sh su hive -l -s /bin/bash -c 'hive --config /usr/hdp/current/hive-server2/conf/ --service metatool -listFSRoot' 2>/dev/null | grep hdfs:// | cut -f1,2,3 -d '/' | grep -v 'hdfs://ayoub-poc-assurance.us-central1-c.c.astute-elixir-219512.internal:8020' | head -1'] {}
2018-10-25 14:59:49,864 - call returned (0, '')
2018-10-25 14:59:49,865 - Execute['/var/lib/ambari-agent/tmp/start_hiveserver2_script /var/log/hive/hive-server2.out /var/log/hive/hive-server2.err /var/run/hive/hive-server.pid /usr/hdp/current/hive-server2/conf/ /etc/tez/conf'] {'environment': {'HIVE_BIN': 'hive', 'JAVA_HOME': u'/usr/jdk64/jdk1.8.0_112', 'HADOOP_HOME': u'/usr/hdp/current/hadoop-client'}, 'not_if': 'ls /var/run/hive/hive-server.pid >/dev/null 2>&1 && ps -p >/dev/null 2>&1', 'user': 'hive', 'path': [u'/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/var/lib/ambari-agent:/var/lib/ambari-agent:/usr/hdp/current/hive-server2/bin:/usr/hdp/3.0.1.0-187/hadoop/bin']}
2018-10-25 14:59:49,894 - Execute['/usr/jdk64/jdk1.8.0_112/bin/java -cp /usr/lib/ambari-agent/DBConnectionVerification.jar:/usr/hdp/current/hive-server2/lib/mysql-connector-java.jar org.apache.ambari.server.DBConnectionVerification 'jdbc:mysql://ayoub-poc-assurance.us-central1-c.c.astute-elixir-219512.internal/hive?createDatabaseIfNotExist=true' hive [PROTECTED] com.mysql.jdbc.Driver'] {'path': ['/usr/sbin:/sbin:/usr/local/bin:/bin:/usr/bin'], 'tries': 5, 'try_sleep': 10}
2018-10-25 14:59:50,344 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server ayoub-poc-assurance.us-central1-c.c.astute-elixir-219512.internal:2181 ls /hiveserver2 | grep 'serverUri=''] {}
2018-10-25 14:59:51,009 - call returned (1, '')
....
2018-10-25 15:04:06,641 - Will retry 5 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s)
2018-10-25 15:04:16,646 - Process with pid 17878 is not running. Stale pid file at /var/run/hive/hive-server.pid Could you please help me ?
... View more
β10-25-2018
01:07 PM
Hello community, I already installed my HDP 3.0 and started my required services. However, even if all my services started well without any issues, my Hive service is still not running. I have an issue with hiveserver2 start, I'm getting the error given below : 2018-10-25 12:33:59,215 - Will retry 6 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s)
2018-10-25 12:34:09,223 - Process with pid 29602 is not running. Stale pid file at /var/run/hive/hive-server.pid
Can someone help me please ? It's an emergency... Thank you in advance π
... View more
Labels: