Skip to main content
Eric_B
Silver ⭐️⭐️⭐️
May 31, 2022 7:30 PM UTC
Question

NiFi InvokeHTTP -Is there DNS caching or something that would interfere with GSLB failover?

Version: NiFi 1.11.x

 

Noticed a behavior where for this version of NiFi, when the remote url is a GSLB, it doesn't recognize when a host is removed from a GSLB until the processor is stopped. Any idea why? Any ideas for a solution?

5 replies

Eric_B
Eric_BAuthor
Silver ⭐️⭐️⭐️
Jun 17, 2022 4:13 PM UTC

Kind of an update: A jank workaround was to force the Connection to close, but it's not the best solution. Looking to see why the client is ignoring the DNS TTL.

Translate
araujo
Platinum ⭐️⭐️⭐️
Platinum ⭐️⭐️⭐️
Jun 25, 2022 5:47 AM UTC

@Eric_B ,

 

This is a behaviour inherited from Java. Java caches DNS resolved names internally.

You can adjust the cache TTL value by specifying the corresponding Java property during NiFi startup.

 

Please see a description of the property here: https://docs.aws.amazon.com/sdk-for-java/v1/developer-guide/java-dg-jvm-ttl.html

 

Cheers,

André

 

Translate
-- Was your question answered? Please take some time to click on "Accept as Solution" below this post. If you find a reply useful, say thanks by clicking on the thumbs up button.
Eric_B
Eric_BAuthor
Silver ⭐️⭐️⭐️
Sep 27, 2022 5:16 PM UTC

Hi @araujo ! That seems to be cause, but I'm a bit confused on how I would set it up. I attempted to both set it in the bootstrap as well as via the jre, but still nothing seems to be working. 

Translate
araujo
Platinum ⭐️⭐️⭐️
Platinum ⭐️⭐️⭐️
Sep 28, 2022 7:18 AM UTC

Can you share your settings?

Translate
-- Was your question answered? Please take some time to click on "Accept as Solution" below this post. If you find a reply useful, say thanks by clicking on the thumbs up button.
Eric_B
Eric_BAuthor
Silver ⭐️⭐️⭐️
Oct 11, 2022 6:34 PM UTC

I've attempt to set the above in the java.security file and in the bootstrap I set the runtime variables as
java.arg.20=-Djava.security.networkaddress.cache.ttl=60
java.arg.21=-Dsun.net.inetaddr.ttl=60

Translate