Member since
01-11-2016
355
Posts
230
Kudos Received
74
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
8212 | 06-19-2018 08:52 AM | |
3160 | 06-13-2018 07:54 AM | |
3595 | 06-02-2018 06:27 PM | |
3915 | 05-01-2018 12:28 PM | |
5423 | 04-24-2018 11:38 AM |
11-28-2017
04:22 PM
Hi @Matthew Gaetano There's another feature in the UpdateProcessor that you can use which Rules : https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-update-attribute-nar/1.4.0/org.apache.nifi.processors.attributes.UpdateAttribute/additionalDetails.html This feature is available in the advanced settings and you can use to define conditions and actions. So you can say if condition than update timestamps, else do not. Look at my answer to this question to see how you can use it : https://community.hortonworks.com/questions/140060/nifi-how-to-load-a-value-in-memory-one-time-from-c.html?childToView=140233#answer-140233
... View more
11-27-2017
05:49 PM
@Nilesh same answer for one topic. If you send the same data several times to Kafka you will get it several times when you consume.
... View more
11-27-2017
04:38 PM
1 Kudo
Hi @Rustam Fatkullin You can use MergeContent before the CreateHadoopSequenceFile. If you have several types and you want to store them in separated files use RouteOnAttribute before. https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-hadoop-nar/1.4.0/org.apache.nifi.processors.hadoop.CreateHadoopSequenceFile/additionalDetails.html
... View more
11-25-2017
02:31 PM
Hi @Nilesh There's no relation between data in two different topics. Reading from one topic and writing to another one will copy (and duplicate) data
... View more
11-25-2017
01:15 PM
Hi @Matthew Gaetano You should be able to do this using an UpdateAttribute with the state feature. You can add an UpdateAttribute to the flow: And configure it as follows: This way, each flow file going to InvokeHttp will have two attributes: Timestamp : the current time previousTimestamp : the time of the previous execution. You can use this in your InvokeHttp. Here's an example of attributes that InvokeHttp will have access to (in my case I execute this every minute as you can see) Is this what you are looking for?
... View more
11-23-2017
10:55 AM
Hi @Andrew Chisholm Thank you for your feedback. I confirm that and I run into the same problem. I forgot to mention it when writing this blog. I created a Jira to track it : https://issues.apache.org/jira/browse/NIFI-4634
... View more
11-08-2017
02:45 PM
Hi @Michael Jonsson Again, NiFi is not available on HDI and you can not install it from Ambari in HDI. Starting from HDF 3 it's possible to deploy HDF component on HDP cluster using management packs but this is for HDP not HDI : https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.0.1.1/bk_installing-hdf-on-hdp/content/ch_install-mpack.html The link you provided is also deprecated, lot of things changed since then 🙂
... View more
11-08-2017
01:54 PM
2 Kudos
@Salda Murrah I forgot to tell about IdentifyMimeType that can be used to automatically identify the type of your file https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.IdentifyMimeType/index.html
... View more
11-08-2017
01:51 PM
I am not sure I understand your use case. Why do you use UnpackContent after Compress ? CompressContent can decompress your gz file with the decompress option.
... View more
11-08-2017
09:51 AM
Hi @Michael Jonsson The link you refer to uses a custom Ambari Service for NiFi. It's not official neither supported: https://github.com/abajwa-hw/ambari-nifi-service As you can see, the post is old and the service is no more updated by its author (see deprication note on the Github page).
... View more