Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

nfs gateway

nfs gateway

New Contributor

I'm trying to point elasticsearch path.data to hdfs nfs gateway but keep getting the elasticsearch error eventhough the permissions look fine for me

total 2 drwxrwxrwx 3 3473700172 1227 96 Dec 6 04:39 .

drwxrwxrwx 3 elasticsearch 1227 96 Dec 15 11:49 nodes

drwxr-xr-x 12 1237 1227 384 Dec 15 15:48 ..

Here is the error logs

org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to created node environment at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:125) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:112) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.cli.SettingCommand.execute(SettingCommand.java:54) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:96) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.cli.Command.main(Command.java:62) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:89) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:82) ~[elasticsearch-5.1.1.jar:5.1.1] Caused by: java.lang.IllegalStateException: Failed to created node environment at org.elasticsearch.node.Node.<init>(Node.java:252) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.node.Node.<init>(Node.java:229) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Bootstrap$6.<init>(Bootstrap.java:214) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:214) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:306) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:121) ~[elasticsearch-5.1.1.jar:5.1.1] ... 6 more Caused by: java.nio.file.AccessDeniedException: /hdfs/elasticsearch/nodes/0/_state/node-3.st.tmp at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) ~[?:?] at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?] at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?] at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) ~[?:?] at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434) ~[?:1.8.0_111] at java.nio.file.Files.newOutputStream(Files.java:216) ~[?:1.8.0_111] at org.elasticsearch.gateway.MetaDataStateFormat.write(MetaDataStateFormat.java:123) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.env.NodeEnvironment.loadOrCreateNodeMetaData(NodeEnvironment.java:406) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:261) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.node.Node.<init>(Node.java:249) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.node.Node.<init>(Node.java:229) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Bootstrap$6.<init>(Bootstrap.java:214) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:214) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:306) ~[elasticsearch-5.1.1.jar:5.1.1] at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:121) ~[elasticsearch-5.1.1.jar:5.1.1]

3 REPLIES 3

Re: nfs gateway

Contributor

Can you describe "why" you are trying to mount NFS gateway to ElasticSearch? There might be a better solution we can recommend.

I have not seen this as a common integration with ElasticSearch and it may not be supported. While ElasticSearch may be able to write to a normal NFS mounted drive, HDFS NFS gateway does not implement ALL the NFS capability, specifically:

File append is supported but random write is not supported.

https://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html

Re: nfs gateway

New Contributor

Hi Wes,

What is the solution you recomend. I alread took a look here http://hortonworks.com/blog/configure-elastic-search-hadoop-hdp-2-0/ but look like the data will be stored both on hdfs and elasticsearch cluster.

Thanks

Re: nfs gateway

Contributor

I recommend checking with ElasticSearch to see if HDFS is supported as a storage medium for your ES indexes. It is not apparent from the documentation whether or not this is possible using ElasticSearch (Lucene): https://www.elastic.co/guide/en/elasticsearch/hadoop/5.1/es-yarn.html

Alternatively, Solr (HDP Search) does support storage indexes to HDFS: https://cwiki.apache.org/confluence/display/solr/Running+Solr+on+HDFS

Don't have an account?
Coming from Hortonworks? Activate your account here