About Wynner

Wynner · ‎04-20-2017

@Gu Gur I agree, that would be a nice tool. But a difficult task because there are unique environments for almost each user and multiple environments for each user.

Wynner · ‎04-20-2017

@Gu Gur I believe you would have to grab the entire NiFi branch from github and then replace the zookeeper with the newer version in the branch and then rebuild NiFi on your system.

Wynner · ‎04-20-2017

@John T Try using this for the Remote File property /home/user/.*${FileToFetch}.* The ".*" says any character, any number of characters. So for your example, it will grab any file that contains "file123.txt" anywhere in the name.

Wynner · ‎04-20-2017

@Raphaël MARY Try setting the cron run schedule to 0 0 10 * * ? instead. The reason the other cron schedule grabbed the same file multiple times is because the * * for second and minutes meant run every second and every minute for that hour.

Wynner · ‎04-20-2017

@Raphaël MARY What does your cron run schedule look like?

Wynner · ‎04-20-2017

@Rohit Ravishankar Yes the file will be processed and while the 31GB file is being processed, back pressure will be applied. Back pressure does not prevent files larger than the 1GB from being processed. It just tries to limit the size of the queue to 1GB. Back pressure will not be disabled until the queue size is below the 1GB threshold.

Wynner · ‎04-20-2017

@Harish S I am glad you were able to correct the issue by configuring the correct KDC server in the jaas.conf file.

Wynner · ‎04-20-2017

@Yogesh Sharma Here are a couple of links to articles that are a good starting point for best practices and dataflow design. Dataflow Optimization NiFi Best Practices for high performance

Wynner · ‎04-19-2017

@Raj B I cannot see a situation where you would get a token back, but not be able to use NiFi.

Wynner · ‎04-19-2017

@Raj B If you are only looking for a heartbeat, the fact that you can get a token back should be enough. So, you only need the one curl command that works?

Online	Offline
Last Visited	‎10-31-2025 01:29 PM

Member Since	‎07-30-2019 10:40 AM
Last Visited	‎10-31-2025 01:29 PM
Posts	944
Kudos received	197

Cloudera Community

Re: Authentication issue while connecting Nifi to ...

Re: Execute Stream Command - NIFI

Re: How to initialize a processor via NIFI API

Re: HDF cluster in PROD managed by Ambari, did a c...

Re: consuming from kafka topics using NiFi consume...

Re: NIFI: Node discovering for Cluster

Re: NiFi: What version of Zookeeper is used in NiF...

Re: Does the FetchSftp Processor support wildcards...

Re: NiFi CRON read mutliple times

Re: NiFi CRON read mutliple times

Re: Query regarding Back Pressure Threshold limit

Re: NiFi unable to connect to kafka in kerberized ...

Re: ListSFTP+FetchFTP vs GETSFTP ??

Re: NiFi API & "Unable to validate the access toke...

Re: NiFi API & "Unable to validate the access toke...