Cloudera Labs
Provide feedback on Cloudera Labs
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark Omniture setup job failed

Highlighted

Spark Omniture setup job failed

New Contributor

Hi,

I ran the following to setup omniture table hit_data:
spark2-submit --files hit_data.avsc --jars lib/omniture-2.0.jar,lib/omnituredata-1.0.1.jar,lib/accelerator-schema-utils-1.0.jar lib/envelope-0.4.0.jar omniture-setup.conf
but got the error:
18/08/27 18:56:36 INFO parser.CatalystSqlParser: Parsing command: boolean
Exception in thread "main" java.util.concurrent.ExecutionException: org.apache.spark.sql.AnalysisException: Operation not allowed: ALTER TABLE RECOVER PARTITIONS only works on table with location provided: tem_cja_raw.hit_data;
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at com.cloudera.labs.envelope.run.Runner.awaitAllOffMainThreadsFinished(Runner.java:318)
at com.cloudera.labs.envelope.run.Runner.runBatch(Runner.java:285)
at com.cloudera.labs.envelope.run.Runner.run(Runner.java:92)
at com.cloudera.labs.envelope.EnvelopeMain.main(EnvelopeMain.java:45)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:755)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: org.apache.spark.sql.AnalysisException: Operation not allowed: ALTER TABLE RECOVER PARTITIONS only works on table with location provided:

 

this issue occurred in CDH5.13.3 and the same code ran fine in CDH 5.8.3.

 

Hope someone have the solution for this issue.

 

Thanks a lot!