Member since
07-30-2019
944
Posts
197
Kudos Received
91
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1789 | 10-05-2021 01:53 PM | |
| 17469 | 09-23-2019 06:03 AM | |
| 7694 | 05-04-2019 08:42 PM |
03-27-2023
02:09 AM
@TB_19 as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.
... View more
06-11-2022
01:40 AM
@MattWho Thanks Matt, I understand what you're saying. in my case it's the other way around, I have clients (MiNiFi) initiating the connections when they want to send or receive data. This helps me deal with remote firewalls not allowing incoming connections and sporadic availability as they're the ones starting the connection. At the moment, with S2S, The MiNiFi's connect periodically (every 10s) to see I there are any flowfiles waiting for them. I would need to figure out how to periodically generate that action to perform the same flow. Example scenarios: 1. Client (MiNiFi side) is running a tail on a file. A new line comes into the file and needs to be sent over to NiFi for processing. 2. NiFi wants to send a file to the remote MiNiFi running a putfile processor. I have both scenarios working right now with S2S with no issues to a bunch of MiNiFi's, it's just that this requires hacky workarounds (scripts to modify the MiNiFi yml) to make this work and I would love to figure out a cleaner solution.
... View more
06-08-2022
12:33 PM
1 Kudo
@_anjos Have you tried setting server.1=node1:2888:3888;2181
... View more
12-29-2021
09:31 AM
@Arash What exactly does the agent flow do? TailFile --> RemoteProcessGroup to NiFi?
... View more
12-29-2021
08:57 AM
@nnndb You are using version JAVA 8 update 11? If so, try using at least JAVA 8 update 252.
... View more
10-05-2021
01:53 PM
@dansteu
There are multiple changes needed in the properties.
The Atlas Configuration Directory shouldn't be on the /tmp directory. The ideal location would be a directory in the default class path of NiFi.
Create Atlas Configuration File should be set to true
If Kerberos is being used for authentication, why is the URL http and not https?
For the NIFi URL for Atlas, it would be better to use http://${hostname(true)}:8080/nifi this will provide a URL that will map back to the NiFi component that generated the Atlas lineage
The Atlas Default Metadata Namespace should be populated with a value that is representative of the flow. For example, For example, hdf352 or testflowversion1, or something similar.
... View more
12-07-2020
01:14 AM
Hi Wynner, I am trying to publish the message on queue following the same procedure but geeting this error. Thank you
... View more
06-26-2020
08:18 AM
2 Kudos
The MiNiFi Java agent builds the nifi.properties file from default values and the ones exposed in the config.yml. To override the default values not exposed in the config.yml, a property must be added to the config.yml in the NiFi Properties Overrides section.
For example, content archiving is disabled by default. To enable this, add the following in the config.yml file:
NiFi Properties Overrides: {
nifi.content.repository.archive.max.retention.period: 1 hour,
nifi.content.repository.archive.max.usage.percentage: 10%,
nifi.content.repository.archive.enabled: 'true'
}
Then, save the config.yml and restart the agent. If you look at the nifi.properties file, you will see the updated values.
NOTE: This is a known issue (internal bug CEM-967) when using the Edge Flow Manager (EFM) to publish flows to the Java agent. When a new flow is published, the agent does not retain the overridden properties. Hence, the properties have to be re-entered manually and then the agent has to be restarted.
... View more
Labels:
09-23-2019
06:03 AM
@budati If you cannot get the blank space in, then just go back to the default of ; and add it between the parameters in the Command Arguments property.
... View more