Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hue: Spark Job Server error

Highlighted

Hue: Spark Job Server error

Explorer

I am trying to get the Spark Job Server up by follwing this doc.

I get an error :

> jobserver re-start
[error] Not a valid key: jobserver
[error] jobserver re-start
[error]

 


Anything i am missing here?

6 REPLIES 6
Highlighted

Re: Hue: Spark Job Server error

Could you use type:
> re-start

?

Romain

Highlighted

Re: Hue: Spark Job Server error

Explorer

I get the same error 

 

> re-start
[error] Not a valid command: re-start
[error] No such setting/task
[error] re-start

Highlighted

Re: Hue: Spark Job Server error

Could you share the full shell execution from typing 'sbt' ?

Romain

Highlighted

Re: Hue: Spark Job Server error

Explorer

$ sbt/sbt
[info] Loading project definition from /foo/SparkJobServer/spark-server/project/project
[info] Updating {file:/foo/SparkJobServer/spark-server/project/project/}default-752741...
[info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
[info] Done updating.
[info] Compiling 1 Scala source to /foo/SparkJobServer/spark-server/project/project/target/scala-2.9.2/sbt-0.12/classes...
[info] Loading project definition from /foo/SparkJobServer/spark-server/project
[info] Updating {file:/foo/SparkJobServer/spark-server/project/}plugins...
[info] Resolving org.scala-sbt#precompiled-2_10_1;0.12.4 ...
[info] Done updating.
[info] Compiling 1 Scala source to /foo/SparkJobServer/spark-server/project/target/scala-2.9.2/sbt-0.12/classes...
[info] Set current project to root (in build file:/foo/SparkJobServer/spark-server/)
> project
[info] root (in build file:/foo/SparkJobServer/spark-server/)
> jobserver re-start
[error] Not a valid key: jobserver
[error] jobserver re-start
[error] ^
> restart
[error] Not a valid command: restart
[error] Expected '/'
[error] Expected ':'
[error] Not a valid key: restart (similar: re-start, re-status, re-start-args)
[error] restart
[error] ^
> re-start
[error] Not a valid command: re-start
[error] No such setting/task
[error] re-start
[error]

Highlighted

Re: Hue: Spark Job Server error

Did you try only:

sbt

then

re-start

e.g.

{code}
/tmp/spark-jobserver$ sbt
Loading /usr/share/sbt/bin/sbt-launch-lib.bash
[info] Loading project definition from /tmp/spark-jobserver/project
Missing bintray credentials /home/romain/.bintray/.credentials. Some
bintray features depend on this.
Missing bintray credentials /home/romain/.bintray/.credentials. Some
bintray features depend on this.
Missing bintray credentials /home/romain/.bintray/.credentials. Some
bintray features depend on this.
[info] Set current project to spark-jobserver (in build
file:/tmp/spark-jobserver/)
> re-start
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/JobManagerActor.scala
message=File line length exceeds 110 characters line=102
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/JobManagerActor.scala
message=Avoid using return line=186 column=6
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=23 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=24 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=25 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=26 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=28 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=36 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=37 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=38 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=39 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=40 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=41 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=42 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=43 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=48 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=49 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/io/JobSqlDAO.scala
message=Public method must have explicit type line=50 column=8
warning
file=/tmp/spark-jobserver/job-server/src/spark.jobserver/SparkJob.scala
message=Method name does not match the regular expression
'^([+-/\\*]|[a-z][A-Za-z0-9]*)$' line=10 column=6
Processed 23 file(s)
Found 0 errors
Found 19 warnings
Finished in 4 ms
[success] created:
/tmp/spark-jobserver/job-server/target/scalastyle-result.xml
[warn] Credentials file /home/romain/.bintray/.credentials does not exist
[warn] Credentials file /home/romain/.bintray/.credentials does not exist
Processed 11 file(s)
Found 0 errors
Found 0 warnings
Finished in 0 ms
[success] created:
/tmp/spark-jobserver/akka-app/target/scalastyle-result.xml
[info] Application job-server not yet started
[info] Starting application job-server in the background ...
job-server Starting spark.jobserver.JobServer.main()
[success] Total time: 3 s, completed Jun 24, 2014 6:02:41 PM
{code}

Romain

Highlighted

Re: Hue: Spark Job Server error

Contributor

Hi romain,

 

i've try "sbt" only, but look like it's not a valid command, i got this:

root@00master:~/spark-server# sbt
No command 'sbt' found, did you mean:
Command 'skt' from package 'latex-sanskrit' (main)
Command 'sb2' from package 'scratchbox2' (universe)
Command 'sbd' from package 'cluster-glue' (main)
Command 'mbt' from package 'mbt' (universe)
Command 'sbmt' from package 'atfs' (universe)
Command 'lbt' from package 'lbt' (universe)
Command 'st' from package 'suckless-tools' (universe)
Command 'sb' from package 'lrzsz' (universe)
sbt: command not found

 

I'm currently trying to enable Spark WebUI on CDH 5.2.

 

Thanks !

Don't have an account?
Coming from Hortonworks? Activate your account here