Reply
Explorer
Posts: 8
Registered: ‎07-22-2015

When running a query in Hive against an HBase table, the Hadoop job goes into kill status

  • When I run a Hive query on the HBase table, the job gets to 40% and then gets killed. 
  • Can you tell me why the Hive query is being killed?

Posts: 1,896
Kudos: 433
Solutions: 303
Registered: ‎07-31-2013

Re: When running a query in Hive against an HBase table, the Hadoop job goes into kill status

How many files does your query generate before this happens?

Hive may kill jobs if they produce too many files, as one reason. This can
be controlled via something like "SET hive.exec.max.created.files=655350;"

Do you see any error of the below form at the client or in the task logs?
That may help confirm if its cause of this.

ERROR org.apache.hadoop.hive.ql.exec.Task: [Fatal Error] total number
of created files now is 100008, which exceeds 100000. Killing the job.


Explorer
Posts: 8
Registered: ‎07-22-2015

Re: When running a query in Hive against an HBase table, the Hadoop job goes into kill status

Thanks Harsh for your precisous time ,

 

At the tail end of the Hive log that shows the query gets to the map-reduce stage before it gets killed

Explorer
Posts: 8
Registered: ‎07-22-2015

Re: When running a query in Hive against an HBase table, the Hadoop job goes into kill status

Hi Harsh,

 

I am able to see the error in the below form

 

org.apache.hadoop.hive.ql.exec.persistence.RowContainer: RowContainer created

Explorer
Posts: 8
Registered: ‎07-22-2015

Re: When running a query in Hive against an HBase table, the Hadoop job goes into kill status

Hi Anyone can help me on this 

Announcements

Our community is getting a little larger. And a lot better.


Learn More about the Cloudera and Hortonworks community merger planned for late July and early August.