About jmedel

jmedel · ‎05-17-2016

Thank you Pierre!

jmedel · ‎05-17-2016

I figured out the solution to the issue. SplitXml splits the children of the parent element in XML file into separate flowfiles. When that happens, the flowfiles receive duplicate names cause the children share the same filename as the original XML file. So, I used a updateAttribute processor to give each flowfile a distinct name. Then when the flowfiles were routed to mergeContent processor, I looked at the list queue to check if the flowfiles all had distinct names and they did. I checked the directory the putfile stored the flowfiles into and they were present as expected. Thank you for the quick response! Here is an image of my updated dataflow:

jmedel · ‎05-17-2016

I almost done creating the DataFlow that ingests vehicle location data from traffic stream simulator, does some filtering on that data and lands the data into a new JSON file. The problem occurs with the mergeContent processor. It shows an error of "duplicate entry." I set UnpackContent's and MergeContent's appropriate property value to zip. Why do I receive this error? Here is an image of the NiFi DataFlow with the error message: GetFile -> UnpackContent -> ControlRate -> EvaluateXPath -> SplitXml -> EvaluateXPath -> RouteOnAttribute -> AttributesToJSON -> MergeContent -> PutFile

jmedel · ‎04-09-2016

Thank you! it worked! sandbox.hortonworks.com:6667 putkafka-success-run.png Is the write for PutKafka suppose to be 0 bytes? Thanks.

jmedel · ‎04-09-2016

I added localhost:6667 to the property value section of the PutKafka processor. I am still getting the same error. Any other ideas on how to solve this error? Thank you again.

jmedel · ‎04-08-2016

Hello, I am learning how to use the PutKafka processor to store my live trucking data as a message into kafka. However, when I start my dataflow, I receive the following error message: putkafka-error.png I also included the property values that I have set for my PutKafka processor: error-putkafka-processor.png The Client Name value is Zookeeper. I have the latest version of HDF 1.2. Why am I receiving this error? Here is my nifi template: iot-stream-kafka-nifi.xml Any help is highly appreciated! Thank you!

jmedel · ‎03-14-2016

Hello Michael for now an alternative way to access Zeppelin and Storm is through their web addresses: Storm UI http://127.0.0.1:8744/ Zeppelin Notebook http://127.0.0.1:9995/#/ Note: the latest sandbox refresh will be available soon.

jmedel · ‎03-14-2016

Hi Michael, Which version of the sandbox do you have? Use the terminal command sandbox-version to find your version. I have the following version: [root@sandbox ~]# sandbox-version Sandbox information: Created on: 11_03_2016_13_17_16 for virtualbox Hadoop stack version: Hadoop 2.7.1.2.4.0.0-169 Ambari Version: 2.2.1.0 Ambari Hash: 6a8abfa65789b87da764549c27ca0f1440b91297 Ambari build: Release : 161 Java version: 1.7.0_95 OS Version: CentOS release 6.7 (Final) and tez view in ambari views is available. Check out the pictures below. If you have a different version of the sanbox, you can download the latest version on our download page. Let me know if you have any further problems. Update: On the latest version of sandbox, I do not need to grant permissions to maria_dev to use tez view. However, for other views, such as Zeppelin and Storm you will need to grant them permission using admin login.

jmedel · ‎03-09-2016

@Charles Clifford @zblanco Yes, the Sentiment Analysis Tutorial covers installing Nifi on the Sandbox. It also covers port forwarding if the user is unable to connect to the web address " along with other steps to analyze, transform and visualize that twitter data.

jmedel · ‎03-08-2016

Hey guys. The tutorial mentioned above has been updated and is also compatible with the latest Sandbox HDP 2.4. It addresses the issue of permissions. Here is the link: http://hortonworks.com/hadoop-tutorial/how-to-process-data-with-apache-hive/ When you a chance, can you go through the tutorial on our new Sandbox?

Online	Offline
Last Visited	‎07-19-2018 02:00 AM

Member Since	‎03-07-2016 10:06 PM
Last Visited	‎07-19-2018 02:00 AM
Posts	37
Kudos received	12

Cloudera Community

Cloudera Community

Re: Error while installing maven

Re: Why does MergeContent have a "duplicate entry"...

Re: Why does MergeContent have a "duplicate entry"...

Re: Why does MergeContent have a "duplicate entry"...

Why does MergeContent have a "duplicate entry" err...

Re: NiFi - PutKafka Error "failed while waiting fo...

Re: NiFi - PutKafka Error "failed while waiting fo...

NiFi - PutKafka Error "failed while waiting for ac...

Re: Tutorial step 2.6.5 "Explore TEZ": Cannot see ...

Re: Tutorial step 2.6.5 "Explore TEZ": Cannot see ...

Re: Sandbox 2.4 Nifi connection refused

Re: Error on Tutorial "How to Process Data with Ap...