Member since
09-06-2017
9
Posts
1
Kudos Received
0
Solutions
02-04-2018
07:55 PM
@NaveenGangam thanks for your reply 1. the second step is successfully finished. use ''select * from tablename" can show the contents exactly right. 2. no 'LOCAL' keyword is because the '/tmp/new.txt' is the on the HDFS. 3. CDH version is 5.13.1 4. and question is how could I make this step successed insert into table new_tmp_orc select * from new_tmp; is there any documents about loading json data into the orc type table ? cos I couldn't find any one on the internet,,and I feel so hopeless.....
... View more
01-30-2018
02:16 AM
1 Kudo
version: clouder-manager-5.13.1
os: ubuntu14.04
here is my operation step:
1.
create table new_tmp(action_type string,event_detail string, uuid string) ROW FORMAT SERDE 'org.apache.hive.hcatalog.data.JsonSerDe';
2.
load data inpath '/tmp/new.txt' into table new_tmp;
3.
create table new_tmp_orc(action_type string,event_detail string, uuid string) ROW FORMAT SERDE 'org.apache.hive.hcatalog.data.JsonSerDe' STORED AS ORC;
4.
insert into table new_tmp_orc select * from new_tmp;
and It report this error:
Error while processing statement: FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.spark.SparkTask
in the log file,/var/log/hive/hadoop-cmf-hive-HIVESERVER2-node1.log.out . it's like this:
2018-01-30 17:15:46,331 ERROR org.apache.hadoop.hive.ql.exec.spark.status.SparkJobMonitor: [HiveServer2-Background-Pool: Thread-58]: Status: Failed .........( omit some DEBUG and INFO level messages) 2018-01-30 17:15:46,372 ERROR org.apache.hadoop.hive.ql.Driver: [HiveServer2-Background-Pool: Thread-58]: FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.spark.SparkTask
.........(omit some DEBUG and INFO level messages)....
2018-01-30 17:15:46,444 ERROR org.apache.hive.service.cli.operation.Operation: [HiveServer2-Background-Pool: Thread-58]: Error running hive query: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.spark.SparkTask at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:400) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:238) at org.apache.hive.service.cli.operation.SQLOperation.access$300(SQLOperation.java:89) at org.apache.hive.service.cli.operation.SQLOperation$3$1.run(SQLOperation.java:301) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917) at org.apache.hive.service.cli.operation.SQLOperation$3.run(SQLOperation.java:314) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
I've searched on the internet for days,still don't get a clue........
really appreciate if you could help
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Spark
-
Cloudera Manager
09-11-2017
12:24 AM
could you tell me how to open the port 8022 ? thank you very much
... View more