Reply
Explorer
Posts: 9
Registered: ‎08-29-2017

CDH 5.11.1 Hive -org.apache.thrift.TException: Error in calling method FetchResults

[ Edited ]

 

I am working in cloud era package.

 

I am trying a insert overwrite query in beeline hive shell.

 

Also trying a select statment with group by query.

 

Tried incremantal false and true from beeline

 

Getting exceptions.

 

I am getting following exceptions in beeline hive shell

 

Beeline Hive shell> GC overhead limit exceeded

 

Then

 

Unknown HS2 problem when communicating with Thrift server.

Error: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe (state=08S01,code=0)

0: jdbc:hive2://x01shdpeapp1a.sgp.dbs.com:100> org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset

 

 

In Beeline Hive shell I am trying to use : set hive.execution.engine=spark

 

 Hive on Spark Execution Error

 

 

INFO : 2017-09-13 15:11:02,667 Stage-1 map = 100%, reduce = 100%, Cumulative C PU 1325.08 sec

INFO : MapReduce Total cumulative CPU time: 22 minutes 5 seconds 80 msec

INFO : Ended Job = job_1504841859638_16131

INFO : MapReduce Jobs Launched:

INFO : Stage-Stage-1: Map: 2 Reduce: 1 Cumulative CPU: 1325.08 sec HDFS Re ad: 57181 HDFS Write: 4645215555 SUCCESS

INFO : Total MapReduce CPU Time Spent: 22 minutes 5 seconds 80 msec

INFO : Completed executing command(queryId=hive_20170913144242_abc47556-41ba-4f 5f-8e19-48e2c185dee4); Time taken: 1732.086 seconds

INFO : OK

org.apache.thrift.TException: Error in calling method FetchResults

at org.apache.hive.jdbc.HiveConnection$SynchronizedHandler.invoke(HiveCo nnection.java:1317)

at com.sun.proxy.$Proxy4.FetchResults(Unknown Source)

at org.apache.hive.jdbc.HiveQueryResultSet.next(HiveQueryResultSet.java: 363)

at org.apache.hive.beeline.BufferedRows.<init>(BufferedRows.java:43)

at org.apache.hive.beeline.BeeLine.print(BeeLine.java:2051)

at org.apache.hive.beeline.Commands.executeInternal(Commands.java:1002)

at org.apache.hive.beeline.Commands.execute(Commands.java:1192)

at org.apache.hive.beeline.Commands.sql(Commands.java:1106)

at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1169)

at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1003)

at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:915)

at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java :511)

at org.apache.hive.beeline.BeeLine.main(BeeLine.java:494)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:497)

at org.apache.hadoop.util.RunJar.run(RunJar.java:221)

at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

Posts: 630
Topics: 3
Kudos: 102
Solutions: 66
Registered: ‎08-16-2016

Re: CDH 5.11.1 Hive -org.apache.thrift.TException: Error in calling method FetchResults

You have a couple of issues here. The GC overhead limit exceed can usually be overcome by setting this in the Java Opts: -XX:-UseGCOverheadLimit

I am not finding an example of how to do this for the beeline client. I'll try again later and post it.

Beeline Hive shell> GC overhead limit exceeded
Posts: 630
Topics: 3
Kudos: 102
Solutions: 66
Registered: ‎08-16-2016

Re: CDH 5.11.1 Hive -org.apache.thrift.TException: Error in calling method FetchResults

I am less certain second issue but it is launching a MR app and not at Spark app. Along with the error it makes me think that Hive on Spark is not properly configured and therefor not working.
Explorer
Posts: 9
Registered: ‎08-29-2017

Re: CDH 5.11.1 Hive -org.apache.thrift.TException: Error in calling method FetchResults

[ Edited ]

1.png

 

This is result of hive on map reduce mode

Highlighted
Explorer
Posts: 9
Registered: ‎08-29-2017

Re: CDH 5.11.1 Hive -org.apache.thrift.TException: Error in calling method FetchResults

Hive on spark error

 

INFO  : 2017-09-14 13:12:23,585 Stage-0_0: 2/2 Finished Stage-1_0: 0(+6,-18)/6

ERROR : Status: Failed

ERROR : FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.spark.SparkTask

INFO  : Completed executing command(queryId=hive_20170914130000_8d0cb66f-b782-4795-b60a-52064880a7cf); Time taken: 688.847 seconds

Error: Error while processing statement: FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.spark.SparkTask (state=08S01,code=3)

Posts: 630
Topics: 3
Kudos: 102
Solutions: 66
Registered: ‎08-16-2016

Re: CDH 5.11.1 Hive -org.apache.thrift.TException: Error in calling method FetchResults

Can you access the jobs logs for each and see if there is an exception in them that can shed some light on what is going wrong?
Announcements