HTTPFS Installation Failure / Start-up Failure

savanna_endicot — Wed, 16 Nov 2016 16:45:18 GMT

Hi there,

I have a 6-node HDP cluster, and am trying to install and use the HTTPFS server. I have enabled NameNode HA on my cluster. I followed this article by @David Streever: HTTPFS - Configure and Run with HDP

The error I'm getting is the following. I have played around with this a ton, and this is actually the third time I've tried installing it on a fresh node. I am hoping someone can help, as I am stumped.

[root@xxxxxxxxxxxx sbin]# ./httpfs.sh run
/usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 32: /usr/hdp/current/hadoop/libexec/httpfs-config.sh: No such file or directory
/usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 37: print: command not found
/usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 50: print: command not found
Using CATALINA_BASE:   /usr/hdp/current/hadoop-httpfs
Using CATALINA_HOME:   /etc/hadoop-httpfs/tomcat-deployment
Using CATALINA_TMPDIR: /usr/hdp/current/hadoop-httpfs/temp
Using JRE_HOME:        /usr
Using CLASSPATH:       /etc/hadoop-httpfs/tomcat-deployment/bin/bootstrap.jar
Nov 16, 2016 8:29:31 AM org.apache.tomcat.util.digester.SetPropertiesRule begin
WARNING: [SetPropertiesRule]{Server} Setting property 'port' to '' did not find a matching property.
Nov 16, 2016 8:29:31 AM org.apache.catalina.core.AprLifecycleListener init
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
Nov 16, 2016 8:29:31 AM org.apache.coyote.http11.Http11Protocol init
INFO: Initializing Coyote HTTP/1.1 on http-0
Nov 16, 2016 8:29:31 AM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 511 ms
Nov 16, 2016 8:29:31 AM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Nov 16, 2016 8:29:31 AM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/6.0.44
Nov 16, 2016 8:29:31 AM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory webhdfs
log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Nov 16, 2016 8:29:32 AM org.apache.catalina.core.StandardContext start
SEVERE: Error listenerStart
Nov 16, 2016 8:29:32 AM org.apache.catalina.core.StandardContext start
SEVERE: Context [/webhdfs] startup failed due to previous errors
Nov 16, 2016 8:29:32 AM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory ROOT
Nov 16, 2016 8:29:32 AM org.apache.coyote.http11.Http11Protocol start
INFO: Starting Coyote HTTP/1.1 on http-0
Nov 16, 2016 8:29:32 AM org.apache.catalina.startup.Catalina start
INFO: Server startup in 737 ms

After seeing this, I thought the first problem seemed to be "Tomcat Native library... was not found ...". So I ran yum install tomcat, which did install things. But then I tried to start httpfs and got all of the same errors... So I may have to undo that now.

I'm hoping that I'm just missing something simple.

Any help is much appreciated

Re: HTTPFS Installation Failure / Start-up Failure

mugdha — Thu, 17 Nov 2016 11:07:44 GMT

@Savanna Endicott

I think you have set HADOOP_HOME:-/usr/hdp/current/hadoop

It should be HADOOP_HOME:-/usr/hdp/current/hadoop-client

linexec is under hadoop-client folder.

Re: HTTPFS Installation Failure / Start-up Failure

savanna_endicot — Thu, 17 Nov 2016 16:22:20 GMT

@Mugdha wow... that fixed everything. Can't believe I didn't clue into that. THANK YOU!

question Re: HTTPFS Installation Failure / Start-up Failure in Support Questions

HTTPFS Installation Failure / Start-up Failure

Re: HTTPFS Installation Failure / Start-up Failure

Re: HTTPFS Installation Failure / Start-up Failure