Member since
02-22-2018
14
Posts
0
Kudos Received
0
Solutions
04-13-2021
02:22 AM
Hello, Do you have any test to be sure the cluster is working fine after all those steps ? I move one node ever 3. I put some files on the hdfs and i don't see file system in the dfs.journalnode.edits.dir even whether for the old or new Journal Node. Best Regards Abdou
... View more
10-09-2018
02:17 PM
Hello @Matt Clarke, Thanks for your reply. In the meanstime I was debuging NiFi ..... And you are right, the processor will be executing as soon as the number/size of file is below the under the threshold ( ie the queue is not full). The Back Pressure is applied in NIFI 1.5 here (this piece of code made me understand the stuff ) private boolean isBackPressureEngaged() {
return procNode.getIncomingConnections().stream()
.filter(con -> con.getSource() == procNode)
.map(con -> con.getFlowFileQueue())
.anyMatch(queue -> queue.isFull());
} Thanks for your quick response. Best Regards Abdou
... View more
10-09-2018
08:59 AM
Hello Matt, The source processor will be stopped when the size / number is reached. But Do you know when does the source processor is restarted ?? Best regards Abdou
... View more