Member since
03-05-2018
23
Posts
0
Kudos Received
0
Solutions
06-03-2018
07:22 PM
Hello @William Brooks i tired your options but looks like it not working.It has executed on the same time and 2 flow file inserted in to down stream .
... View more
06-03-2018
02:30 AM
Hello @Shu .I think you are giving me a reply based on subject line but now problem is as below. In above screen shot you can see the setting for Monitor activity with this setting my jobs are running in productions everyday but problem occurred when Querydatabase table processor triggered in different instance and monitor activity processor triggered on different instance and in this case since data is there so at 9 am Querydatabase table processor produce one flow file and its loaded to table and now at 10 Am monitor activity also gets executed and its generate one flow file and again my table got loaded with 0 count data .Can we restrict both processor can run on same instance or any other solution you have for this issue. Monitor activity is generating flow file in both case when querydatabses table processor is generatng flow file in cases of delta data and if querydatabses table processor is not generatngflow file in cases of delta data. We need flow file in case of when querydatabses table processor is not generatngflow file . Regards, Shantanu
... View more
06-02-2018
08:50 PM
Thanks you @William Brooks I will apply your concept and let you know the result. Thanks, Shantanu
... View more
06-01-2018
06:19 PM
Hello @Shu I am facing some issue with Monitor activity . If you do not mind can you help me on it. In above screen shot you can see the setting for Monitor activity with this setting my jobs are running in productions everyday but problem occurred when Querydatabase table processor triggered in different instance and monitor activity processor triggered on different instance and in this case since data is there so at 9 am Querydatabase table processor produce one flow file and its loaded to table and now at 10 Am monitor activity also gets executed and its generate one flow file and again my table got loaded with 0 count data .Can we restrict both processor can run on same instance or any other solution you have for this issue. Regards, Shantanu.
... View more
05-31-2018
09:30 PM
Thank you We are already using Monitoring Scope = cluster but still the problem is there.
... View more
05-31-2018
02:50 PM
Hello Guys, I am facing some issue with Monitor Activity processor . We are extracting data by using QueryDatabaseTable processor its mean we are extracting only delta records but some time delta is not coming so we have used Monitor Activity processor in this scenario to generate one dummy flow file for keep moving my down stream flow but the problem is our Nifi is running on 3 server in production and we have scheduled QueryDatabaseTable processor at 9 AM UTC and Monitor Activity processor at 10 AM UTC and when the flow started at 9 am QueryDatabaseTable processor runs at different server and it has extracted data and it send to down stream and loaded to hive now at 10 am Monitor Activity processor also got executed and generated a flow file because its has executed on different server is there any way to run both processor on same server or any setting inside Monotor activity processor? @shu Regards, Shantanu.
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache NiFi
05-22-2018
08:06 PM
Thanks for the reply @shu and @Dukool SHarma . I am not writing any Map and reduce job. On the query level i.e in hive query can we call this LazyOutputFormat?. My table formate is ORC. Regards, Shantanu
... View more
05-18-2018
03:49 PM
Can you please explain how we can implement this concept? Regards, Shantanu.
... View more
03-26-2018
04:52 PM
If i will set Continually Send Messages is true then everyday if data will not available then i can get flow file? right now it has in false stat.
... View more