Reply
New Contributor
Posts: 7
Registered: ‎01-16-2015

HIVE Query Fails but can preview data

[ Edited ]

HI

Installed Cluster with no issues and hive queries working. After restarting AWS and services HIVE query gives error (Impala OK) below. Can preview data ok. Restarted just HIVE and still error. Any idea? Thanks

 

SELECT * FROM intermediate_access_logs

 

Error below

 

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

 

INFO  : Number of reduce tasks is set to 0 since there's no reduce operator
WARN  : Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
INFO  : number of splits:21
INFO  : Submitting tokens for job: job_1449846736284_0007
INFO  : The url to track the job: http://cloudera1:8088/proxy/application_1449846736284_0007/
INFO  : Starting Job = job_1449846736284_0007, Tracking URL = http://cloudera1:8088/proxy/application_1449846736284_0007/
INFO  : Kill Command = /opt/cloudera/parcels/CDH-5.4.2-1.cdh5.4.2.p0.2/lib/hadoop/bin/hadoop job  -kill job_1449846736284_0007
INFO  : Hadoop job information for Stage-1: number of mappers: 21; number of reducers: 0
INFO  : 2015-12-11 11:26:22,471 Stage-1 map = 0%,  reduce = 0%
INFO  : 2015-12-11 11:26:55,503 Stage-1 map = 5%,  reduce = 0%
INFO  : 2015-12-11 11:26:56,533 Stage-1 map = 0%,  reduce = 0%
INFO  : 2015-12-11 11:27:10,908 Stage-1 map = 5%,  reduce = 0%
INFO  : 2015-12-11 11:27:11,932 Stage-1 map = 0%,  reduce = 0%
INFO  : 2015-12-11 11:27:12,957 Stage-1 map = 100%,  reduce = 0%
ERROR : Ended Job = job_1449846736284_0007 with errors

Other Log Details


Task with the most failures(4): 
-----
Task ID:
  task_1449846736284_0008_m_000015

URL:
  http://cloudera1:8088/taskdetails.jsp?jobid=job_1449846736284_0008&tipid=task_1449846736284_0008_m_000015
-----
Diagnostic Messages for this Task:
Error: java.lang.RuntimeException: Error in configuring object
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:449)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
	... 9 more
Caused by: java.lang.RuntimeException: Error in configuring object
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
	... 14 more
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
	... 17 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
	at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:147)
	... 22 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: Class org.apache.hadoop.hive.contrib.serde2.RegexSerDe not found
	at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:323)
	at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:333)
	at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:116)
	... 22 more
Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.hive.contrib.serde2.RegexSerDe not found
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2018)
	at org.apache.hadoop.hive.ql.plan.PartitionDesc.getDeserializer(PartitionDesc.java:139)
	at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:297)
	... 24 more
Cloudera Employee
Posts: 435
Registered: ‎07-12-2013

Re: HIVE Query Fails but can preview data

Can you click on the tracking link? That should take you to a web UI run by
Hadoop where you should be able to find some more logs from the underlying
job itself. Note that because "cloudera1" is not defined outside the
cluster, you'll need to replace that in the URL with the IP address of your
Manager Node.
Highlighted
Contributor
Posts: 27
Registered: ‎10-29-2015

Re: HIVE Query Fails but can preview data

Hi Brit,

 

One of the log refer to Regex Serde issue:

 

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: Class org.apache.hadoop.hive.contrib.serde2.RegexSerDe not found

You may also verify if the serde is added and available in the mentioned path in Metastore before this job is executed.

 

 

Thanks

snm1502

Announcements