Member since
09-24-2016
3
Posts
0
Kudos Received
0
Solutions
09-26-2016
07:55 AM
Hi Bryan, Thanks for your sound advice. I put in the core-site.xml and hdfs-site.xml paths you've suggested and created the logAttribute processors. The output is now written to HDFS, and the logAttribute 'succes'-flow is populating accordingly. The bytes-written amount remains 0 though. Possibly a bug?
... View more
09-24-2016
11:54 AM
Hello, I am a newbie at Hadoop and Nifi. Hopefully that'll change soon. I have installed a Hortonworks sandbox, and added HDF-2.0.0.0 on it, installing and running nifi as a service. I have configured a dataflow based on the "Pull from Twitter gardenhose" template, which seems to work fine, except that there's no output in the putHDFS processor: There are no messages or warnings in the nifi UI, except when I changed the directory entry in the properties to "hdfs://sanbox.hortonworks.com/....". I suspect that I have the wrong core-site.xml and/or hdfs-site.xml files specified (there are a dozen of each on the sandbox...), but I don't know where to look for error descriptions. It could also be related to teh fact that I don't run the sandbox on localhost but in the LAN (with the network setting in the virtualbox set to "bridged"). The files: logs/nifi-app.log, nifi-bootstrap.log and nifi-user.log have no data regarding this process. Update: I found the bulletins setting, and put it to DEBUG. This helps already. Can I view them somewhere outside the UI? Only the last 3 are showing... Can anyone point out to me where to find the error logs for this processor? Many thanks for reading this far already 🙂
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache NiFi