Member since
07-30-2019
333
Posts
356
Kudos Received
76
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9860 | 02-17-2017 10:58 PM | |
2294 | 02-16-2017 07:55 PM | |
7974 | 12-21-2016 06:24 PM | |
1757 | 12-20-2016 01:29 PM | |
1232 | 12-16-2016 01:21 PM |
12-01-2016
01:29 PM
1 Kudo
Hi Avijeet. This is currently not possible, but do take a look at the following proposal to understand where things are going in the future: https://cwiki.apache.org/confluence/display/NIFI/Configuration+Management+of+Flows
... View more
11-29-2016
09:29 PM
1 Kudo
Please check in the nifi-app.log file, not bootstrap. Most probably there is a service in your host already taking the 8080 port. You can edit conf/nifi.properties and modify the port to a non-conflicting one.
... View more
11-22-2016
05:11 PM
1 Kudo
Depending on the format of your data, you might be better off using the ScanAttribute https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.ScanAttribute/index.html It will reference an external file for a match and route the flowfile accordingly. E.g. follow up with an UpdateAttribute to update/add to the metadata.
... View more
11-22-2016
01:13 PM
Let's simplify the config to eliminate misconfiguration in other areas. If you want A to initiate the connection, you can remove those nifi.remote.* properties on the A side. Next, the port 8443 is not the best choice, as it often is used for https on non-privileged port. It's not even required now, as NiFi's s2s can tunnel over HTTP. Remove input.socket.port on the B side. Finally, please share which URL you used in the RPG setup (the UI on the A side). The GoTo action simply opens a new browser window. What we are looking for is being able to Refresh the RPG and see ports after 20-30 seconds after initial setup. Few more things to validate. I understand this is not a secured instance, so port access permissions aren't in play. Make sure, though, that instance B has input/output ports added the root top-level processing group, this is a requirements for the s2s.
... View more
11-15-2016
09:21 PM
I would be very cautious about that statement. In a highly available environment Kafka brokers don't just come and go. They are part of a replication group and persisted topic data must follow or be replicated to another host if a node is gone.
... View more
11-14-2016
01:05 PM
2 Kudos
You can specify a list of brokers. The main difference in Kafka from before was client-managed offsets, i.e. ZK was no longer on the read path for a consumer. Also, why would you expect brokers to keep changing?
... View more
11-09-2016
04:36 PM
1 Kudo
Hi Obaid, currently HDF installs its own ZK quorum. In the future colocating HDF & HDP in the same cluster will be supported through a single Ambari instance to better reuse infrastructure components. http://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.0.1/bk_ambari-installation/content/ch_installing-ambari.html
... View more
11-09-2016
12:21 AM
1 Kudo
Hey Andrew, If your message is a valid JSON (it seems to be), then a parser is able to read it an decode a literal string. The next trick is to put this results into a FlowFile content/body and run another EvaluateJsonPath/JoltTransformer chain. I did a quick experiment here, and it seems to work fine.
... View more
11-08-2016
11:19 PM
1 Kudo
Scott, Use ExecuteScript processor, as mentioned in the article. Looks like you are putting an embedded script into ExecuteProcess, which is meant to invoke OS shell commands, hence the error.
... View more
11-08-2016
08:02 PM
1 Kudo
Make sure to go over the Dev Guide - a great collection of best practices for processor developers: https://nifi.apache.org/docs/nifi-docs/html/developer-guide.html
... View more