Member since
11-22-2018
11
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1020 | 02-05-2020 05:38 AM |
02-05-2020
05:38 AM
the issue is resolved now. I have a cluster of 12 nodes. and on some nodes beeline-hs2Connection.xml was not present. putting the file in hive conf directory on each server resolved the issue. thanks Mohit
... View more
01-29-2020
01:18 AM
please help me on connecting to hive using sqoop action. In my case it not picking the hive user and password from beeline-hs2-connection.xml. Kindly suggest how can I provide user password to sqoop action for making correct connection string using user ans password... Your suggestions will be a great help... hoping for a reply... its been a long I am stuck on this....I am using HDP 3
... View more
01-13-2020
11:15 PM
I am still stuck on connecting to hive. I can connect to it giving beeline connection url and embading query in it in shell action beeline -u "jdbc:hive2://hmaster1.nic.in:2181,hmaster2.nic.in:2181,hmaster3.nic.in:2181/default;password=hive;serviceDiscoveryMode=zooKeeper;user=hive;zooKeeperNamespace=hiveserver2 " -e "CREATE TABLE IF NOT EXISTS oozietestings1113 (eid int,name String,salary String)"; the above command is working. it connects to hive and create the table as specified. but i do not have an option to provide it in sqoop job . although i tried to give --hs2-url while creating a sqoop job but it is also not working as expected. kindly help on this @DennisJaheruddi @Shelton
... View more
01-09-2020
01:14 AM
I was trying to what is the difference in the process of connecting to hive when oozie connects using hive action and sqoop action. because hive action is working and connection to hive and sqoop action action is not connecting to hive and stuck.
... View more
01-09-2020
12:58 AM
yes I can run the commands with the same user. it shows not error, it is just stuck on connecting to hive. even as mentioned above It is able to connect with hive action but not with sqoop action.
... View more
12-27-2019
01:55 AM
I am trying to run a sqoop job using oozie but it log shows it stucks on connecting to hive. The Hive action is working fine and connecting to hive but sqoop action and shell action both are unable to connect to hive ... please suggest
... View more
Labels:
02-28-2019
06:08 PM
I am running a shell action through oozie in which i am running a sqoop job. The sqoop job can be run without oozie and does not gives any error. but when I run from oozie gives the following error. 2019-02-28 12:53:43,108 ERROR [Job ATS Event Dispatcher] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Exception while publishing configs on JOB_SUBMITTED Event for the job : job_1551336873031_0010
org.apache.hadoop.yarn.exceptions.YarnException: Failed while publishing entity
at org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl$TimelineEntityDispatcher.dispatchEntities(TimelineV2ClientImpl.java:548)
at org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl.putEntities(TimelineV2ClientImpl.java:149)
at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.publishConfigsOnJobSubmittedEvent(JobHistoryEventHandler.java:1254)
at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.processEventForNewTimelineService(JobHistoryEventHandler.java:1414)
at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.handleTimelineEvent(JobHistoryEventHandler.java:742)
at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.access$1200(JobHistoryEventHandler.java:93)
at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler$ForwardingEventHandler.handle(JobHistoryEventHandler.java:1795)
at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler$ForwardingEventHandler.handle(JobHistoryEventHandler.java:1791)
at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:197)
at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:126)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.hadoop.yarn.exceptions.YarnException: Response from the timeline server is not successful, HTTP error code: 500, Server response:
{"exception":"WebApplicationException","message":"org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 241 actions: IOException: 241 times, servers with issues: null","javaClassName":"javax.ws.rs.WebApplicationException"}
at org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl.putObjects(TimelineV2ClientImpl.java:322)
at org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl.putObjects(TimelineV2ClientImpl.java:251)
at org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl$EntitiesHolder$1.call(TimelineV2ClientImpl.java:374)
at org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl$EntitiesHolder$1.call(TimelineV2ClientImpl.java:367)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl$TimelineEntityDispatcher$1.publishWithoutBlockingOnQueue(TimelineV2ClientImpl.java:495)
at org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl$TimelineEntityDispatcher$1.run(TimelineV2ClientImpl.java:433)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more More info on this.... I recently have installed Hbase in my HDP Cluster of 12 nodes each having 128 GB RAM each. The job was running before installing hbase.... I also had to reinstall oozie. Please help on this, Any suggestions would be appreciated. Thanks in adv
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache Oozie
11-26-2018
05:44 AM
In the hiveserver2.log it gives the following error repeatedly. 2018-11-26T11:13:30,160 ERROR [json-metric-reporter]: metrics2.JsonFileMetricsReporter (:()) - Unable to rename temp file /tmp/hmetrics6708564061371615677json to /tmp/report.json
... View more
11-25-2018
02:12 PM
@Richard Dobson Yes, It has enough free space, no jobs running. RAM is 16 GB on each server .Thanks for the reply...
... View more
11-22-2018
09:28 AM
HDP cluster has 3 nodes. One has metastore instance and other two have hiveserver2 instances. The cluster was working fine earlier. The metastore is running but It is giving error while starting hiveserver2 caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) hiveserver2-stderr.txt when I access hive from terminal it starts beeline with an error for hiveserver2 [root@hmaster ~]# hive SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Connecting to jdbc:hive2://hdata1.nic.in:2181,hmaster.nic.in:2181,hdata2.nic.in:2181/default;password=hive;serviceDiscoveryMode=zooKeeper;user=hive;zooKeeperNamespace=hiveserver2 Error: org.apache.hive.jdbc.ZooKeeperHiveClientException: Unable to read HiveServer2 configs from ZooKeeper (state=,code=0) Beeline version 3.1.0.3.0.1.0-187 by Apache Hive beeline> The zookeeper node /hiveserver2 is empty I have also tried removing the zookeeper node /hiveserver2 as suggested in other threads but it does not help. @Josh Elser please help on this Anyone's help will be appreciated...
... View more
Labels:
- Labels:
-
Apache Hive