Created 11-16-2016 08:45 AM
Hi there,
I have a 6-node HDP cluster, and am trying to install and use the HTTPFS server. I have enabled NameNode HA on my cluster. I followed this article by @David Streever: HTTPFS - Configure and Run with HDP
The error I'm getting is the following. I have played around with this a ton, and this is actually the third time I've tried installing it on a fresh node. I am hoping someone can help, as I am stumped.
[root@xxxxxxxxxxxx sbin]# ./httpfs.sh run /usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 32: /usr/hdp/current/hadoop/libexec/httpfs-config.sh: No such file or directory /usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 37: print: command not found /usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 50: print: command not found Using CATALINA_BASE: /usr/hdp/current/hadoop-httpfs Using CATALINA_HOME: /etc/hadoop-httpfs/tomcat-deployment Using CATALINA_TMPDIR: /usr/hdp/current/hadoop-httpfs/temp Using JRE_HOME: /usr Using CLASSPATH: /etc/hadoop-httpfs/tomcat-deployment/bin/bootstrap.jar Nov 16, 2016 8:29:31 AM org.apache.tomcat.util.digester.SetPropertiesRule begin WARNING: [SetPropertiesRule]{Server} Setting property 'port' to '' did not find a matching property. Nov 16, 2016 8:29:31 AM org.apache.catalina.core.AprLifecycleListener init INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib Nov 16, 2016 8:29:31 AM org.apache.coyote.http11.Http11Protocol init INFO: Initializing Coyote HTTP/1.1 on http-0 Nov 16, 2016 8:29:31 AM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 511 ms Nov 16, 2016 8:29:31 AM org.apache.catalina.core.StandardService start INFO: Starting service Catalina Nov 16, 2016 8:29:31 AM org.apache.catalina.core.StandardEngine start INFO: Starting Servlet Engine: Apache Tomcat/6.0.44 Nov 16, 2016 8:29:31 AM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory webhdfs log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Nov 16, 2016 8:29:32 AM org.apache.catalina.core.StandardContext start SEVERE: Error listenerStart Nov 16, 2016 8:29:32 AM org.apache.catalina.core.StandardContext start SEVERE: Context [/webhdfs] startup failed due to previous errors Nov 16, 2016 8:29:32 AM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory ROOT Nov 16, 2016 8:29:32 AM org.apache.coyote.http11.Http11Protocol start INFO: Starting Coyote HTTP/1.1 on http-0 Nov 16, 2016 8:29:32 AM org.apache.catalina.startup.Catalina start INFO: Server startup in 737 ms
After seeing this, I thought the first problem seemed to be "Tomcat Native library... was not found ...". So I ran yum install tomcat, which did install things. But then I tried to start httpfs and got all of the same errors... So I may have to undo that now.
I'm hoping that I'm just missing something simple.
Any help is much appreciated
Created 11-17-2016 03:07 AM
I think you have set HADOOP_HOME:-/usr/hdp/current/hadoop
It should be HADOOP_HOME:-/usr/hdp/current/hadoop-client
linexec is under hadoop-client folder.
Created 11-17-2016 03:07 AM
I think you have set HADOOP_HOME:-/usr/hdp/current/hadoop
It should be HADOOP_HOME:-/usr/hdp/current/hadoop-client
linexec is under hadoop-client folder.
Created 11-17-2016 08:22 AM
@Mugdha wow... that fixed everything. Can't believe I didn't clue into that. THANK YOU!