question Re: Failed to write to parent HDFS directory. in Support Questions

Failed to write to parent HDFS directory.

ronakjangir — Sun, 06 Nov 2016 06:13:31 GMT

error-puthdfs1.png ambari-main.jpg error.jpgerror-puthdfs.pngI am not able to write my files to the parent HDFS directory /tmp/tweets_staging. Please have a look at it, I am attaching the snapshot of the error which I am facing.

Though, I am able to see the data on solr as well as Banana. And in the NiFi template, PutHDFS is the only processor which is showing error.

Note: I have followed every bit of this page.

http://hortonworks.com/hadoop-tutorial/how-to-refine-and-visualize-sentiment-data/

Re: Failed to write to parent HDFS directory.

MattWho — Mon, 07 Nov 2016 21:36:07 GMT

@Ronak Jangir

The HDFS client does not currently support the LzoCodec and the core-site.xml file you are using includes it.

It should work after you remove “com.hadoop.compression.lzo.LzoCodec,com.hadoop.compression.lzo.LzopCodec” from the “io.compression.codecs” property in the “core-site.xml” file you have referenced in your putHDFS processor.

Thanks,

Matt

Re: Failed to write to parent HDFS directory.

ronakjangir — Tue, 08 Nov 2016 10:57:26 GMT

Right on! Thanks @mclark that did the trick.

Re: Failed to write to parent HDFS directory.

martin_van-huse — Fri, 03 Mar 2017 22:56:44 GMT

@Matt Clarke

i have the same issue. how can i go to this file ? i dont find the way to go to this path and this file.

Best Regards,

Martin

Re: Failed to write to parent HDFS directory.

MattWho — Fri, 03 Mar 2017 23:00:33 GMT

@Martin van Husen

The core-site.xml file is copied from your HDFS node to your NiFi node. You modify the local copy on NiFi as described above and point to this file using the the "Hadoop Configuration Resources" property in the NiFi HDFS processor.

Re: Failed to write to parent HDFS directory.

martin_van-huse — Fri, 03 Mar 2017 23:05:11 GMT

Thanks for your fast answer. yes the steps to modify and where to put the path in the processor i understand. But where can i find this xml file. What is the NiFi node ? iam working in the sandbox. Can i reach this file from the ambari manager ?

Re: Failed to write to parent HDFS directory.

MattWho — Fri, 03 Mar 2017 23:09:20 GMT

I don't know where HDFS files are placed in the sandbox, but I know you cannot copy the file from HDFS to NiFi from within Ambari. You will need to do this via a command/terminal window. you could use the "locate" command if you are running on linux and have the "mlocate" package installed.

# yum -y install mlocate # updatedb # locate core-ste.xml

Re: Failed to write to parent HDFS directory.

martin_van-huse — Fri, 03 Mar 2017 23:59:05 GMT

No iam running the sandbox in win 7. ok i will keep searching for the xml file. Thank you.

Re: Failed to write to parent HDFS directory.

martin_van-huse — Sat, 04 Mar 2017 00:37:56 GMT

I found the file now, downloaded it and changed the entry. How do i get this file now back into my sandbox to the right place ?