Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 11-16-2016 08:45 AM
Hi there,
I have a 6-node HDP cluster, and am trying to install and use the HTTPFS server. I have enabled NameNode HA on my cluster. I followed this article by @David Streever: HTTPFS - Configure and Run with HDP
The error I'm getting is the following. I have played around with this a ton, and this is actually the third time I've tried installing it on a fresh node. I am hoping someone can help, as I am stumped.
[root@xxxxxxxxxxxx sbin]# ./httpfs.sh run
/usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 32: /usr/hdp/current/hadoop/libexec/httpfs-config.sh: No such file or directory
/usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 37: print: command not found
/usr/hdp/current/hadoop-httpfs/sbin/httpfs.sh.distro: line 50: print: command not found
Using CATALINA_BASE: /usr/hdp/current/hadoop-httpfs
Using CATALINA_HOME: /etc/hadoop-httpfs/tomcat-deployment
Using CATALINA_TMPDIR: /usr/hdp/current/hadoop-httpfs/temp
Using JRE_HOME: /usr
Using CLASSPATH: /etc/hadoop-httpfs/tomcat-deployment/bin/bootstrap.jar
Nov 16, 2016 8:29:31 AM org.apache.tomcat.util.digester.SetPropertiesRule begin
WARNING: [SetPropertiesRule]{Server} Setting property 'port' to '' did not find a matching property.
Nov 16, 2016 8:29:31 AM org.apache.catalina.core.AprLifecycleListener init
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
Nov 16, 2016 8:29:31 AM org.apache.coyote.http11.Http11Protocol init
INFO: Initializing Coyote HTTP/1.1 on http-0
Nov 16, 2016 8:29:31 AM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 511 ms
Nov 16, 2016 8:29:31 AM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Nov 16, 2016 8:29:31 AM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/6.0.44
Nov 16, 2016 8:29:31 AM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory webhdfs
log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Nov 16, 2016 8:29:32 AM org.apache.catalina.core.StandardContext start
SEVERE: Error listenerStart
Nov 16, 2016 8:29:32 AM org.apache.catalina.core.StandardContext start
SEVERE: Context [/webhdfs] startup failed due to previous errors
Nov 16, 2016 8:29:32 AM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory ROOT
Nov 16, 2016 8:29:32 AM org.apache.coyote.http11.Http11Protocol start
INFO: Starting Coyote HTTP/1.1 on http-0
Nov 16, 2016 8:29:32 AM org.apache.catalina.startup.Catalina start
INFO: Server startup in 737 ms
After seeing this, I thought the first problem seemed to be "Tomcat Native library... was not found ...". So I ran yum install tomcat, which did install things. But then I tried to start httpfs and got all of the same errors... So I may have to undo that now.
I'm hoping that I'm just missing something simple.
Any help is much appreciated
Created 11-17-2016 03:07 AM
I think you have set HADOOP_HOME:-/usr/hdp/current/hadoop
It should be HADOOP_HOME:-/usr/hdp/current/hadoop-client
linexec is under hadoop-client folder.
Created 11-17-2016 03:07 AM
I think you have set HADOOP_HOME:-/usr/hdp/current/hadoop
It should be HADOOP_HOME:-/usr/hdp/current/hadoop-client
linexec is under hadoop-client folder.
Created 11-17-2016 08:22 AM
@Mugdha wow... that fixed everything. Can't believe I didn't clue into that. THANK YOU!