10-31-2017 02:17 PM
Hi, while running the python example on Hue->Query->Editor->Spark it gives a syntax error in the last line which has the %table . Any ideas?
================================================================= >>> Invoking Spark class now >>> File "/yarn/nm/usercache/userxyz/appcache/application_1509052489118_0187/container_1509052489118_0187_01_000002/bikeshare.py", line 22 %table avg_trips_sorted ^ SyntaxError: invalid syntax <<< Invocation of Spark command completed <<< No child hadoop job is executed. Intercepting System.exit(1) <<< Invocation of Main class completed <<< Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [1] Oozie Launcher failed, finishing Hadoop job gracefully
11-13-2017 02:55 PM
%table works only with pySpark after Livy is installed and running.