Member since
07-30-2019
613
Posts
194
Kudos Received
91
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
228 | 10-05-2021 01:53 PM | |
7576 | 09-23-2019 06:03 AM | |
2831 | 05-04-2019 08:42 PM | |
519 | 06-11-2018 12:45 PM | |
6134 | 06-04-2018 01:11 PM |
06-11-2022
01:40 AM
@MattWho Thanks Matt, I understand what you're saying. in my case it's the other way around, I have clients (MiNiFi) initiating the connections when they want to send or receive data. This helps me deal with remote firewalls not allowing incoming connections and sporadic availability as they're the ones starting the connection. At the moment, with S2S, The MiNiFi's connect periodically (every 10s) to see I there are any flowfiles waiting for them. I would need to figure out how to periodically generate that action to perform the same flow. Example scenarios: 1. Client (MiNiFi side) is running a tail on a file. A new line comes into the file and needs to be sent over to NiFi for processing. 2. NiFi wants to send a file to the remote MiNiFi running a putfile processor. I have both scenarios working right now with S2S with no issues to a bunch of MiNiFi's, it's just that this requires hacky workarounds (scripts to modify the MiNiFi yml) to make this work and I would love to figure out a cleaner solution.
... View more
06-08-2022
12:33 PM
1 Kudo
@_anjos Have you tried setting server.1=node1:2888:3888;2181
... View more
05-02-2022
08:41 AM
Could you please share the steps to configure Nifi 0.x baseline
... View more
04-18-2022
08:55 AM
What is that jar file about. Is it an application or Single file app.
... View more
02-22-2022
02:19 PM
@nruak As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks!
... View more
02-02-2022
08:11 AM
Sorry, there is a mode to disable polling option? If i want to load some files in example 3 files and only them and after i want load this to a next rerun of the job as i can to disable the polling function to prevent that the processor is always in waiting or in listening!? Regards, Daniele
... View more
12-29-2021
09:31 AM
@Arash What exactly does the agent flow do? TailFile --> RemoteProcessGroup to NiFi?
... View more
12-29-2021
09:01 AM
@Kavindu The question is not clear. Do you want to have the same data flow running on a different MiNiFi agent pushing the log message to a different NiFi? Or are you trying to have another agent send logs from another system to the same instance of NiFi?
... View more
12-29-2021
08:57 AM
@nnndb You are using version JAVA 8 update 11? If so, try using at least JAVA 8 update 252.
... View more
12-20-2021
03:25 PM
Thank you so much, @dupuy_gregory !
... View more
11-04-2021
08:11 PM
Hi, may i know if you have managed to solve this problem? I was configuring the nifi cluster on the VM with the external zookeeper, and I faced this problem as well. I been struggling for this issues for weeks but still have no ideas to solve it
... View more
10-05-2021
01:53 PM
@dansteu
There are multiple changes needed in the properties.
The Atlas Configuration Directory shouldn't be on the /tmp directory. The ideal location would be a directory in the default class path of NiFi.
Create Atlas Configuration File should be set to true
If Kerberos is being used for authentication, why is the URL http and not https?
For the NIFi URL for Atlas, it would be better to use http://${hostname(true)}:8080/nifi this will provide a URL that will map back to the NiFi component that generated the Atlas lineage
The Atlas Default Metadata Namespace should be populated with a value that is representative of the flow. For example, For example, hdf352 or testflowversion1, or something similar.
... View more
10-01-2021
01:40 AM
Hi, I deleted this file in my ubuntu ec2 instance : 1.content_repository 2.database_repository 3.flowfile_repository 4.provenance_repository and also delete file in conf -> flow.xml.gz after the deleting this files in my ubuntu ec2 instance i will restart nifi.sh after that the nifi is runing but i will open my ip address in chrome http://54.89.235.124:8443/ i am getting this site cann't reached error. in my putty i am getting like this please help to resolve this issue
... View more
07-21-2021
11:27 PM
@Kasun, as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.
... View more
06-02-2021
11:59 AM
I was working with mini i cpp 0.7.0 version for windows system. I have tried building the minifi.exe which is compatible with the widows xp os, but was unsuccessful has the minifi cpp source files were built using the new windows 10 OS libraries. As some on the dll libraries in the cpp agent uses the dlls files present in the newer windows version example "initonceexecuteonce" from kernel32.dll.. which is a windows core os file which cannot be modified further. So the plan of minifi cpp execution on windows xp platform was dropped and used the minifi java for my implmentation.
... View more
06-02-2021
11:04 AM
@H20 What version of NiFi was the template created in and what version of the toolkit is being used to do the transform?
... View more
04-07-2021
10:37 PM
@Maqbool as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.
... View more
03-30-2021
06:10 AM
1 Kudo
@Aaki_08 The success relationship out of the ControlRate processor is why there are two emails. Only route success from ControlRate to the UpdateAttribute processor and there should only be a single email message.
... View more
03-09-2021
10:01 AM
@nishantgupta101 There is no reason you could not write your own custom script that connects to a FTPS endpoint to retrieve a file which can be called via the ExecuteStreamCommand processor. There are also other script based processors that you can use.
... View more
12-07-2020
01:14 AM
Hi Wynner, I am trying to publish the message on queue following the same procedure but geeting this error. Thank you
... View more
10-05-2020
11:54 AM
RSAT services are missing for active directory. Open the Powershell with admin rights and copy and execute below line. Will also work for Windows 10 Pro Clients Add-WindowsCapability –online –Name “Rsat.ActiveDirectory.DS-LDS.Tools~~~~0.0.1.0” you can check afterwards with the command Get-Module ActiveDirectory if its working
... View more
09-04-2020
10:03 PM
@Wynner What do you mean " pull the data" and "reads the data" with GetTCP processor?
... View more
08-30-2020
10:33 PM
Hi @jaypee, I'm also facing a similar issue, is yours resolved? Thanks, Shivansh
... View more
06-26-2020
08:18 AM
1 Kudo
The MiNiFi Java agent builds the nifi.properties file from default values and the ones exposed in the config.yml. To override the default values not exposed in the config.yml, a property must be added to the config.yml in the NiFi Properties Overrides section.
For example, content archiving is disabled by default. To enable this, add the following in the config.yml file:
NiFi Properties Overrides: {
nifi.content.repository.archive.max.retention.period: 1 hour,
nifi.content.repository.archive.max.usage.percentage: 10%,
nifi.content.repository.archive.enabled: 'true'
}
Then, save the config.yml and restart the agent. If you look at the nifi.properties file, you will see the updated values.
NOTE: This is a known issue (internal bug CEM-967) when using the Edge Flow Manager (EFM) to publish flows to the Java agent. When a new flow is published, the agent does not retain the overridden properties. Hence, the properties have to be re-entered manually and then the agent has to be restarted.
... View more
Labels:
06-21-2020
11:15 PM
@juliofalbo, As this is an older post you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.
... View more
03-17-2020
01:00 PM
1 Kudo
@Renew I ran a test with one of the MiNiFi agents and I was successful in tailing a symlink in Windows, (C++ 0.7.0). Which agent and what version of the agent is being used?
... View more
03-16-2020
07:02 AM
@Ajayra Here is a link to the standard MiNiFi documentation: Getting started with MiNiFi It is a great place to start and has a lot of good information.
... View more
02-24-2020
01:06 PM
In the conf/bootstrap.conf there are two settings for JVM Memory. They generally come out of the box set to 512mgs or something like that. We always have to bump them up to 8g. Look for this: java.arg.2=-Xms8g java.arg.3=-Xmx8g Usually if this is the problem you'll get a specific error telling you about it so no guarentees. It sounds like you don't have a lot of memory on your VM period though.
... View more
02-10-2020
10:23 AM
@Sush217 The easiest way to get the templates would be to restart NiFi and then download the saved templates from the NiFi flow. Otherwise, you will have to manually extract the templates from the flow.xml.gz file, which is prone to errors.
... View more