Reply
New Contributor
Posts: 3
Registered: ‎11-13-2018

I'm not sure how to interpret sparktask errore messages

Hello everyone

 

I am using Talend Big Data Platform to implement ELT Jobs with Hive tables. The jobs run with Spark engine.

I have a problem with a Hive on Spark job.

The scope of the task is to join two tables (parquet) and then insert the output into another table (parquet).

The job goes wrong but I am not able to interpet it.

This is the error message:

 

[FATAL]: datahub_rp_cli.j_rp_cli_movimenti_0_1.J_RP_CLI_MOVIMENTI - tRunJob_2 Child job running failed
[statistics] disconnected
Exception in component tELTHiveOutput_9
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.spark.SparkTask
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:279)

 

Trying to find the solution online in the official documentation or forum, I understand that the errors SparkTask (with code 1 or 2 or 3 eccetera) are something like a 'wrapper' of java errors; however I cannot access to hive log because of denied permissions on the server. 

So have you got a lists of causes that can originate somekind of java errors for Sparktask error code =3 ?

Thank you.

Posts: 1,886
Kudos: 425
Solutions: 300
Registered: ‎07-31-2013

Re: I'm not sure how to interpret sparktask errore messages

I replied on your other thread about the return code: https://community.cloudera.com/t5/Batch-SQL-Apache-Hive/Sparktask-execution-error/m-p/86476#M3059

It appears you will require permissions to the logs or a copy of it to investigate further. You can also have your administrative team search for keywords such as your query or query ID and share log snippets.