Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

error R in hue 3.9 notebook

error R in hue 3.9 notebook

Super Collaborator

after execute a<-1+1 in notebook with R i have this error, any sugestions??

Exception in thread "main" java.io.IOException: Cannot run program "sparkR": error=2, No such file or directory
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
        at com.cloudera.hue.livy.repl.sparkr.SparkRSession$.create(SparkRSession.scala:44)
        at com.cloudera.hue.livy.repl.ScalatraBootstrap.init(Main.scala:107)
        at org.scalatra.servlet.ScalatraListener.configureCycleClass(ScalatraListener.scala:67)
        at org.scalatra.servlet.ScalatraListener.contextInitialized(ScalatraListener.scala:23)
        at com.cloudera.hue.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)
        at com.cloudera.hue.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)
        at com.cloudera.hue.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
        at com.cloudera.hue.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)
        at com.cloudera.hue.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
        at com.cloudera.hue.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at com.cloudera.hue.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at com.cloudera.hue.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at com.cloudera.hue.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at com.cloudera.hue.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at com.cloudera.hue.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
        at com.cloudera.hue.jetty.server.Server.start(Server.java:387)
        at com.cloudera.hue.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
        at com.cloudera.hue.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
        at com.cloudera.hue.jetty.server.Server.doStart(Server.java:354)
        at com.cloudera.hue.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
        at com.cloudera.hue.livy.WebServer.start(WebServer.scala:64)
        at com.cloudera.hue.livy.repl.Main$.main(Main.scala:78)
        at com.cloudera.hue.livy.repl.Main.main(Main.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
        at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:163)
        at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:161)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:161)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.io.IOException: error=2, No such file or directory
        at java.lang.UNIXProcess.forkAndExec(Native Method)
        at java.lang.UNIXProcess.<init>(UNIXProcess.java:248)
        at java.lang.ProcessImpl.start(ProcessImpl.java:134)
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)


2 REPLIES 2

Re: error R in hue 3.9 notebook

@Roberto Sancho

Are you running HDP or CDH? What version? Which tutorials? Please provide links to tutorial.

Highlighted

Re: error R in hue 3.9 notebook

Super Guru

By default Spark R is not installed or available in most Hadoop Clusters. You have to have R installed on all your nodes as well the correct version of Spark. What versions of Hadoop, Java, Scala, Hue, Spark and R do you have installed?

Don't have an account?
Coming from Hortonworks? Activate your account here