Hi,
Unable to start the Spark Livy Server 2
ExecutionFailed: Execution of 'curl -s -o /dev/null -w'%{http_code}' --negotiate -u: -k http://random_host.net:8999/sessions | grep 200 ' returned 1. curl: option --negotiate: the installed libcurl version doesn't support this
curl: try 'curl --help' or 'curl --manual' for more information
)
I have tried to install libcurl . but it has latest package
# yum install libcurl
Loaded plugins: fastestmirror, langpacks
Package matching libcurl-7.29.0-35.el7.centos.x86_64 already installed. Checking for update.
Nothing to do
Ambari Says it is started and running .But the error wont go. Refer image attached.
The port is opened and running in the background:
netstat -plant | grep 8999tcp6
0 0 :::8999 :::* LISTEN 4677/java
I have Spark2 livy server in two machines.
1.Machine 1 Spark livy server 2 is running.
2.Machine 2 Spark Livy server 2 is running as per Ambari and terminal . However Ambari says error.
I have verified both the machines logs , it shows both error are similar
(ie Hadoop folder missing , java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset.) n(java.io.FileNotFoundException and File does not exist: /livy2-recovery/v1/batch/st ) the error im getting from 2nd machine not from the 1st machine.
I have disabled the alert and enabled the alert . still it doesn't work.I have ambari agent restarted twice .
. Still it doesn't work.
sp.png
Attached log : sp.txt