Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

Install, config and start HttpFS in HDP 3.1.0

Explorer

Ambari; 2.7.3.0

HDP: 3.1.0

Ubuntu 16.04


Hi there,

I want to use HttpFS. But when I run command:

hdfs httpfs start


But I faced this error:

Exception in thread "main" java.io.IOException: Unable to initialize WebAppContext

at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1156)

at org.apache.hadoop.fs.http.server.HttpFSServerWebServer.start(HttpFSServerWebServer.java:132)

at org.apache.hadoop.fs.http.server.HttpFSServerWebServer.main(HttpFSServerWebServer.java:165)

Caused by: java.lang.RuntimeException: Could not read HttpFS signature secret file: /usr/hdp/3.1.0.0-78/hadoop/conf/httpfs-signature.secret

at org.apache.hadoop.fs.http.server.HttpFSAuthenticationFilter.getConfiguration(HttpFSAuthenticationFilter.java:95)


Can you help me? Thank you.

1 REPLY 1

New Contributor

Hi @LUAN HA,


We had the same issue.


We have added to HDFS Ambari config "hadoop-env template" extra variable:


export HTTPFS_CONFIG=/etc/hadoop-httpfs/conf


In dir:

/etc/hadoop-httpfs/conf 

We have placed secret file:

httpfs-signature.secret


Reboot service from httpfs user:

hdfs --daemon stop httpfs
hdfs --daemon start httpfs


Otherwise httpfs is using default client hadoop config in example: /usr/hdp/3.1.0.0-78/hadoop/conf as the config dir which will be overwritten if you reboot services using Ambari.