Reply
Contributor
Posts: 38
Registered: ‎01-05-2015

No livy spark Server available in HUE

Hi all,

When i logged in into hue ui, the are are aconfiguration issue regarding livy spark server. The Server is not present. Can you tell me please how the issue can be resolved. I use cdh 5.6.

Tanks in advance,
Butkiz
Cloudera Employee
Posts: 723
Registered: ‎07-30-2013

Re: No livy spark Server available in HUE

Livy is not supported in CDH, we recommend to pick it from Hue upstream
https://github.com/cloudera/hue/tree/master/apps/spark/java or
https://github.com/cloudera/livy
Contributor
Posts: 38
Registered: ‎01-05-2015

Re: No livy spark Server available in HUE

When i start live_server the the following error occurs.

 

cloudera@cdh-master:~$ sudo /opt/cloudera/parcels/CDH/lib/hue/build/env/bin/hue livy_server
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH/lib/hue/build/env/bin/hue", line 12, in <module>
    load_entry_point('desktop==3.9.0', 'console_scripts', 'hue')()
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/desktop/core/src/desktop/manage_entry.py", line 57, in entry
    execute_from_command_line(sys.argv)
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/management/__init__.py", line 399, in execute_from_command_line
    utility.execute()
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/management/__init__.py", line 392, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/management/base.py", line 242, in run_from_argv
    self.execute(*args, **options.__dict__)
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/management/base.py", line 285, in execute
    output = self.handle(*args, **options)
  File "/opt/cloudera/parcels/CDH-5.6.0-1.cdh5.6.0.p0.45/lib/hue/apps/spark/src/spark/management/commands/livy_server.py", line 82, in handle
    os.execvpe(args[0], args, env)
  File "/usr/lib/python2.7/os.py", line 353, in execvpe
    _execvpe(file, args, env)
  File "/usr/lib/python2.7/os.py", line 380, in _execvpe
    func(fullname, *argrest)
OSError: [Errno 2] No such file or directory
Cloudera Employee
Posts: 723
Registered: ‎07-30-2013

Re: No livy spark Server available in HUE

It could be that 'spark' exec is not on the machine, or you are using CDH
which does not ship Livy out of the box currently.