Reply
Highlighted
New Contributor
Posts: 1
Registered: ‎06-28-2016

Spark Omniture setup job failed

Hi,

I ran the following to setup omniture table hit_data:
spark2-submit --files hit_data.avsc --jars lib/omniture-2.0.jar,lib/omnituredata-1.0.1.jar,lib/accelerator-schema-utils-1.0.jar lib/envelope-0.4.0.jar omniture-setup.conf
but got the error:
18/08/27 18:56:36 INFO parser.CatalystSqlParser: Parsing command: boolean
Exception in thread "main" java.util.concurrent.ExecutionException: org.apache.spark.sql.AnalysisException: Operation not allowed: ALTER TABLE RECOVER PARTITIONS only works on table with location provided: tem_cja_raw.hit_data;
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at com.cloudera.labs.envelope.run.Runner.awaitAllOffMainThreadsFinished(Runner.java:318)
at com.cloudera.labs.envelope.run.Runner.runBatch(Runner.java:285)
at com.cloudera.labs.envelope.run.Runner.run(Runner.java:92)
at com.cloudera.labs.envelope.EnvelopeMain.main(EnvelopeMain.java:45)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:755)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: org.apache.spark.sql.AnalysisException: Operation not allowed: ALTER TABLE RECOVER PARTITIONS only works on table with location provided:

 

this issue occurred in CDH5.13.3 and the same code ran fine in CDH 5.8.3.

 

Hope someone have the solution for this issue.

 

Thanks a lot!

 

 

Announcements

Currently incubating in Cloudera Labs:

Envelope
HTrace
Ibis
Impyla
Livy
Oryx
Phoenix
Spark Runner for Beam SDK
Time Series for Spark
YCSB