Created 11-16-2016 08:45 AM
Hi there,
I have a 6-node HDP cluster, and am trying to install and use the HTTPFS server. I have enabled NameNode HA on my cluster. I followed this article by @David Streever: HTTPFS - Configure and Run with HDP
The error I'm getting is the following. I have played around with this a ton, and this is actually the third time I've tried installing it on a fresh node. I am hoping someone can help, as I am stumped.
[root@xxxxxxxxxxxx sbin]# ./httpfs.sh run
/usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 32: /usr/hdp/current/hadoop/libexec/httpfs-config.sh: No such file or directory
/usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 37: print: command not found
/usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 50: print: command not found
Using CATALINA_BASE: /usr/hdp/current/hadoop-httpfs
Using CATALINA_HOME: /etc/hadoop-httpfs/tomcat-deployment
Using CATALINA_TMPDIR: /usr/hdp/current/hadoop-httpfs/temp
Using JRE_HOME: /usr
Using CLASSPATH: /etc/hadoop-httpfs/tomcat-deployment/bin/bootstrap.jar
Nov 16, 2016 8:29:31 AM org.apache.tomcat.util.digester.SetPropertiesRule begin
WARNING: [SetPropertiesRule]{Server} Setting property 'port' to '' did not find a matching property.
Nov 16, 2016 8:29:31 AM org.apache.catalina.core.AprLifecycleListener init
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
Nov 16, 2016 8:29:31 AM org.apache.coyote.http11.Http11Protocol init
INFO: Initializing Coyote HTTP/1.1 on http-0
Nov 16, 2016 8:29:31 AM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 511 ms
Nov 16, 2016 8:29:31 AM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Nov 16, 2016 8:29:31 AM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/6.0.44
Nov 16, 2016 8:29:31 AM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory webhdfs
log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Nov 16, 2016 8:29:32 AM org.apache.catalina.core.StandardContext start
SEVERE: Error listenerStart
Nov 16, 2016 8:29:32 AM org.apache.catalina.core.StandardContext start
SEVERE: Context [/webhdfs] startup failed due to previous errors
Nov 16, 2016 8:29:32 AM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory ROOT
Nov 16, 2016 8:29:32 AM org.apache.coyote.http11.Http11Protocol start
INFO: Starting Coyote HTTP/1.1 on http-0
Nov 16, 2016 8:29:32 AM org.apache.catalina.startup.Catalina start
INFO: Server startup in 737 ms
After seeing this, I thought the first problem seemed to be "Tomcat Native library... was not found ...". So I ran yum install tomcat, which did install things. But then I tried to start httpfs and got all of the same errors... So I may have to undo that now.
I'm hoping that I'm just missing something simple.
Any help is much appreciated
Created 11-17-2016 03:07 AM
I think you have set HADOOP_HOME:-/usr/hdp/current/hadoop
It should be HADOOP_HOME:-/usr/hdp/current/hadoop-client
linexec is under hadoop-client folder.
Created 11-17-2016 03:07 AM
I think you have set HADOOP_HOME:-/usr/hdp/current/hadoop
It should be HADOOP_HOME:-/usr/hdp/current/hadoop-client
linexec is under hadoop-client folder.
Created 11-17-2016 08:22 AM
@Mugdha wow... that fixed everything. Can't believe I didn't clue into that. THANK YOU!