Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

No livy spark Server available in HUE

No livy spark Server available in HUE

Contributor
Hi all,

When i logged in into hue ui, the are are aconfiguration issue regarding livy spark server. The Server is not present. Can you tell me please how the issue can be resolved. I use cdh 5.6.

Tanks in advance,
Butkiz
3 REPLIES 3

Re: No livy spark Server available in HUE

Livy is not supported in CDH, we recommend to pick it from Hue upstream
https://github.com/cloudera/hue/tree/master/apps/spark/java or
https://github.com/cloudera/livy

Re: No livy spark Server available in HUE

Contributor

When i start live_server the the following error occurs.

 

cloudera@cdh-master:~$ sudo /opt/cloudera/parcels/CDH/lib/hue/build/env/bin/hue livy_server
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH/lib/hue/build/env/bin/hue", line 12, in <module>
    load_entry_point('desktop==3.9.0', 'console_scripts', 'hue')()
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/desktop/core/src/desktop/manage_entry.py", line 57, in entry
    execute_from_command_line(sys.argv)
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/management/__init__.py", line 399, in execute_from_command_line
    utility.execute()
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/management/__init__.py", line 392, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/management/base.py", line 242, in run_from_argv
    self.execute(*args, **options.__dict__)
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/management/base.py", line 285, in execute
    output = self.handle(*args, **options)
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/apps/spark/src/spark/management/commands/livy_server.py", line 82, in handle
    os.execvpe(args[0], args, env)
  File "/usr/lib/python2.7/os.py", line 353, in execvpe
    _execvpe(file, args, env)
  File "/usr/lib/python2.7/os.py", line 380, in _execvpe
    func(fullname, *argrest)
OSError: [Errno 2] No such file or directory
Highlighted

Re: No livy spark Server available in HUE

It could be that 'spark' exec is not on the machine, or you are using CDH
which does not ship Livy out of the box currently.