Member since
02-22-2018
14
Posts
0
Kudos Received
0
Solutions
04-13-2021
02:22 AM
Hello, Do you have any test to be sure the cluster is working fine after all those steps ? I move one node ever 3. I put some files on the hdfs and i don't see file system in the dfs.journalnode.edits.dir even whether for the old or new Journal Node. Best Regards Abdou
... View more
10-12-2018
02:49 PM
You may also tried : cd /usr/lib/python2.6/site-packages/resource_monitoring/psutil
python setup.py build
... View more
10-09-2018
02:17 PM
Hello @Matt Clarke, Thanks for your reply. In the meanstime I was debuging NiFi ..... And you are right, the processor will be executing as soon as the number/size of file is below the under the threshold ( ie the queue is not full). The Back Pressure is applied in NIFI 1.5 here (this piece of code made me understand the stuff ) private boolean isBackPressureEngaged() {
return procNode.getIncomingConnections().stream()
.filter(con -> con.getSource() == procNode)
.map(con -> con.getFlowFileQueue())
.anyMatch(queue -> queue.isFull());
} Thanks for your quick response. Best Regards Abdou
... View more
10-09-2018
08:59 AM
Hello Matt, The source processor will be stopped when the size / number is reached. But Do you know when does the source processor is restarted ?? Best regards Abdou
... View more
07-10-2018
09:27 AM
Hello Guys, I was wondering if it was possible to automate service add in Ambari ? I know i can use a blue print to install a server but , I don't see any resources about installing a single service with blue prints ... Best Regards. Abdou
... View more
Labels:
- Labels:
-
Apache Ambari
04-17-2018
01:04 PM
Hello@Timothy Spann, Did you find any work around for this issue ? Or is there any Ambari patch ? Best Regards Abdou
... View more
04-13-2018
05:05 PM
Hello @Matt Clarke, It is ok. "This Whitelist feature is already part of the HDF 3.1 release from
Hortonworks and will be part of the Apache NiFi 1.6 release at a later
time. " I thought that NIFI 1.5 (which is included in HDF 3.1) was not working and that HDF 3.1 provided throught ambari some Work around 🙂 Thanks for your help ! Best Regards Abdou
... View more
04-13-2018
02:58 PM
Hello @Matt Clarke, Could you please share the link to the Ambari Whitelist Configuration ? this only link I found in Ambari wiki is about the Ambari Metrics White list : https://cwiki.apache.org/confluence/display/AMBARI/Ambari+Metrics+-+Whitelisting Best Regards Abdou
... View more
04-10-2018
03:55 PM
Hello Vincent, Could you please share the link to the Ambari Whitelist Configuration. this only link I found in Ambari wiki is about the Ambari Metrics White list : https://cwiki.apache.org/confluence/display/AMBARI/Ambari+Metrics+-+Whitelisting Best Regards Abdou
... View more
03-30-2018
12:36 PM
Hello Guys, I used a RHEL 7 and I have Python 2.7 and this is not building the psutils. Is there any workaround ? Best regards
... View more
03-27-2018
12:05 PM
Hello Ashnee, could you please provide a little more information ? Best Regards Abdou
... View more
03-07-2018
02:04 PM
Hello Matt, Sorry for the delay, but I did not see your answer before. I needed to support server and client Authentification. I ended up using a different keystore for storing the various key I used. Best regards Abdou
... View more
02-22-2018
01:11 PM
Hello, I was setup Flow in NIFI based on KAFKA processor to consume message from KAFKA. The communication between NIFI and KAFKA is done throught SSL. Then I need to use a StandardSSLContextService. And I need to define the Keystore and Truststore. As there are some flow that already use SSL in my NIFI cluster, I already have a Keystore and a Truststore. I would like to get your opinion about the keystore and truststore strategy. Should I use a different keystore or/and a different trustStrore from the one already defined ? Should I only backup the origine keystore/truststore and revert back to old files in case any problems appears ? During the test should I use test keystore and test truststore, and then only integrate the certificate when everything is clean ? And concerning the StandardSSLContextService, should i use one per keystore or truststore ? or should I create a StandardSSLContextService per use case even if the keystore and truststore are the same ? Best Regards Abdou
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi