Member since
10-27-2016
18
Posts
1
Kudos Received
0
Solutions
02-22-2017
03:58 PM
Nifi version 1.1.0.2.1.0.0-165. Two single node instances, S1 and S2 running on same VM. S1 has output ports at the top level. S2 defines a RPG referring back to S1's output port. S2 runs system out of disk space. S2 is brought down, logs cleared, and setting changed to only keep one day of logs (this is development environment). S2 is brought back up, everything seemed fine. Later what's noticed is S2 RPG to S1 starts showing connection errors. Did a status check on S1 and it showed S1 was still running. S1's UI came up fine also. When I looked closer though I found logging on S1 had stopped where the last message was [2017-02-21 10:59:06,413 ERROR [pool-8-thread-1]
org.wali.MinimalLockingWriteAheadLog Failed to create new journal for Partition-74, java.io.IOException: No space left on device] due to {} java.io.IOException: No space left on device]
Was just wondering if there was some other way to detect S1 had become a zombie other than the UI error being shown on S2's RPG? I cannot be definite but I assume if I had tried to really do anything on S1's UI it would have failed (though it came up ok). Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
12-08-2016
01:43 PM
Chrome 55.0.2883.75 m, ok I found the issue. The default value is not editable, you have to replace the entire value. Thank you for the assist
... View more
12-08-2016
12:48 PM
When I drop a RemoteProcessorGroup on the grid the URL field is pre-populated and greyed out (Read Only). After filling in all the fields and pressing ADD I get a "Configuration Error - The specified remote process group URL is malformed". Any help with what I am doing wrong would be appreciated. Nifi-1.2.3.2.0.1.0-12
... View more
Labels:
- Labels:
-
Apache NiFi
12-07-2016
03:05 PM
Thanks @kkawamura
... View more
12-06-2016
11:07 PM
1 Kudo
I have a 3 node cluster. When I bring all three nodes down, then start them up at the same time there is always a 300 second Cluster coordinator wait. I was wondering if this process can be sped up (via a setting or a different startup procedure). During that 5 mins the UI can be seen as an independent node but no editing can be done on existing flows created with all 3 nodes of the cluster up and connected. Thanks - J.Thomas King
... View more
Labels:
- Labels:
-
Apache NiFi
11-23-2016
12:17 AM
Thanks for the tips Joe, I will pass them along. Yes I was just proving a large file could be handled on a very small/slow system ==> a larger (JVM) faster system would have no problem. Yes very good efficiency tips, thanks!
... View more
11-22-2016
05:30 PM
It's an interesting feature. It would def speed up the process. Not sure if it would help our application at this point. I was just trouble shooting an issue because a co worker thought nifi was not working with large files (was not seeing indication something was happening and thought the system had locked up).
... View more
11-22-2016
04:52 PM
Nifi 1.0.0, Single Node, small JVM (512MB) Simple flow GetFile --> PutFile Pretest - Copy large 9GB file to input dir of GetFile processor (takes 6.5 mins) Run test - Turn Flow on Issue GetFile gives no indication the file is being ingested UNTIL the action is complete, ie do not see the READ/WRITE counts change, and the Status History does not update for 6.5 mins. I expected during the 6.5 mins to see the Read/Write counts to increase until they reached 9 GB. What we saw was 0/0 for 6.5 mins, then 9GB/9GB See the same behavior from the PutFile processor Is there a setting to see the in progress counts updating when working with large files. Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
11-18-2016
03:27 PM
Joe - What processor is being illustrated?
... View more
11-08-2016
05:41 PM
Yes - this seems to be working thanks again. I'm having a different issue but getting that resolved. Thanks again
... View more
11-08-2016
03:45 PM
Thank you for the quick reply. I will follow this and report the results
... View more
11-08-2016
03:28 PM
How do I configure a Nifi cluster configuration (HDF2.0) to send and receive data from Kerberized Kafka (10) (also clustered). Have seen standalone examples but none for clusters. Does the Nifi installation have to be Kerberized also?
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi
10-27-2016
09:22 PM
We need guide link on how to connect Nifi to kerberized Kafka.
for version of HDF 2.0 (not 1.2). We found a guide for 1.2 (https://community.hortonworks.com/articles/28180/how-to-configure-hdf-12-to-send-to-and-get-data-fr.html?platform=hootsuite
) but need for HDF 2.0
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi