Member since
03-07-2016
37
Posts
12
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2807 | 07-21-2016 08:00 PM | |
2290 | 05-17-2016 05:45 PM |
05-17-2016
05:57 PM
Thank you Pierre!
... View more
05-17-2016
05:45 PM
1 Kudo
I figured out the solution to the issue. SplitXml splits the children of the parent element in XML file into separate flowfiles. When that happens, the flowfiles receive duplicate names cause the children share the same filename as the original XML file. So, I used a updateAttribute processor to give each flowfile a distinct name. Then when the flowfiles were routed to mergeContent processor, I looked at the list queue to check if the flowfiles all had distinct names and they did. I checked the directory the putfile stored the flowfiles into and they were present as expected. Thank you for the quick response! Here is an image of my updated dataflow:
... View more
05-17-2016
04:52 PM
1 Kudo
I almost done creating the DataFlow that ingests vehicle location data from traffic stream simulator, does some filtering on that data and lands the data into a new JSON file. The problem occurs with the mergeContent processor. It shows an error of "duplicate entry." I set UnpackContent's and MergeContent's appropriate property value to zip. Why do I receive this error? Here is an image of the NiFi DataFlow with the error message: GetFile -> UnpackContent -> ControlRate -> EvaluateXPath -> SplitXml -> EvaluateXPath -> RouteOnAttribute -> AttributesToJSON -> MergeContent -> PutFile
... View more
Labels:
- Labels:
-
Apache NiFi
04-09-2016
08:38 PM
Thank you! it worked! sandbox.hortonworks.com:6667 putkafka-success-run.png Is the write for PutKafka suppose to be 0 bytes? Thanks.
... View more
04-09-2016
02:57 PM
I added localhost:6667 to the property value section of the PutKafka processor. I am still getting the same error. Any other ideas on how to solve this error? Thank you again.
... View more
04-08-2016
09:48 PM
2 Kudos
Hello, I am learning how to use the PutKafka processor to store my live trucking data as a message into kafka. However, when I start my dataflow, I receive the following error message: putkafka-error.png I also included the property values that I have set for my PutKafka processor: error-putkafka-processor.png The Client Name value is Zookeeper. I have the latest version of HDF 1.2. Why am I receiving this error? Here is my nifi template: iot-stream-kafka-nifi.xml Any help is highly appreciated! Thank you!
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi
03-14-2016
11:16 PM
1 Kudo
Hello Michael for now an alternative way to access Zeppelin and Storm is through their web addresses: Storm UI http://127.0.0.1:8744/ Zeppelin Notebook http://127.0.0.1:9995/#/ Note: the latest sandbox refresh will be available soon.
... View more
03-14-2016
05:43 PM
2 Kudos
Hi Michael, Which version of the sandbox do you have? Use the terminal command sandbox-version to find your version. I have the following version:
[root@sandbox ~]# sandbox-version Sandbox information: Created on: 11_03_2016_13_17_16 for virtualbox Hadoop stack version: Hadoop 2.7.1.2.4.0.0-169 Ambari Version: 2.2.1.0 Ambari Hash: 6a8abfa65789b87da764549c27ca0f1440b91297 Ambari build: Release : 161 Java version: 1.7.0_95 OS Version: CentOS release 6.7 (Final) and tez view in ambari views is available. Check out the pictures below. If you have a different version of the sanbox, you can download the latest version on our download page. Let me know if you have any further problems. Update: On the latest version of sandbox, I do not need to grant permissions to maria_dev to use tez view. However, for other views, such as Zeppelin and Storm you will need to grant them permission using admin login.
... View more
03-09-2016
05:45 PM
@Charles Clifford @zblanco Yes, the Sentiment Analysis Tutorial covers installing Nifi on the Sandbox. It also covers port forwarding if the user is unable to connect to the web address " along with other steps to analyze, transform and visualize that twitter data.
... View more
03-08-2016
02:30 AM
Hey guys. The tutorial mentioned above has been updated and is also compatible with the latest Sandbox HDP 2.4. It addresses the issue of permissions. Here is the link: http://hortonworks.com/hadoop-tutorial/how-to-process-data-with-apache-hive/ When you a chance, can you go through the tutorial on our new Sandbox?
... View more
- « Previous
-
- 1
- 2
- Next »