question Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work in Archives of Support Questions (Read Only)

Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

michael_kalika — Thu, 24 Nov 2016 00:14:06 GMT

I'm trying to consume API protected with NTLM authentication [Windows server]. I configured GetHttp process with Url of the server and username + password.

Username in a format of domain/username. I doubled checked the credentials and they are fine.

The GetHttp doesn't work and I am getting 401 [unauthorized] error from the API server.

Here's NiFi log output:

2016-11-23 17:45:22,272 WARN [Timer-Driven Process Thread-7]
o.a.http.impl.auth.HttpAuthenticator NEGOTIATE authentication error: No valid
credentials provided (Mechanism level: No valid credentials provided (Mechanism
level: Failed to find any Kerberos tgt))
2016-11-23 17:45:22,272 WARN [Timer-Driven Process Thread-7]
o.a.http.impl.auth.HttpAuthenticator NTLM authentication error: Credentials
cannot be used for NTLM authentication:
org.apache.http.auth.UsernamePasswordCredentials
2016-11-23 17:45:22,274 ERROR [Timer-Driven Process
Thread-7] o.a.nifi.processors.standard.GetHTTP
GetHTTP[id=91ce7dfd-0158-1000-1c53-cf24cf132983] received status code
401:Unauthorized from http://internal.api.ep/dosomething

I will appreciate any recommendation how to work this out.

Thank you!

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

knarayanan — Thu, 24 Nov 2016 00:17:17 GMT

try adding this to the wifi bootstrap.. http.auth.ntlm.domain = your domain ..

or you can add username@domain as the user.

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

michael_kalika — Thu, 24 Nov 2016 00:28:31 GMT

Thank you! I've just tried both ways and it doesn't work. Anything else I can do?

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

knarayanan — Thu, 24 Nov 2016 00:30:55 GMT

did you add like so to nifi bootstrap

jvm.args.x(+1 the last arg)=-Dhttp.auth.ntlm.domain=hortonworks.com (replace with your domain)/

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

knarayanan — Thu, 24 Nov 2016 00:34:19 GMT

alternatively you can try entering username like so "hortonworks.com\karthik"

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

michael_kalika — Thu, 24 Nov 2016 00:40:31 GMT

Thank you! this is is exactly what I did... I tried it with domain\username, username@domain. Also changed bootstrap.conf configuration as you recommended:

http.auth.ntlm.domain=mydomain

still doesn't work...

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

michael_kalika — Thu, 24 Nov 2016 00:41:20 GMT

yes, I added the line in bootstrap.conf configuration as you recommended:

http.auth.ntlm.domain=mydomain

still doesn't work

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

knarayanan — Thu, 24 Nov 2016 01:18:47 GMT

Looks like gethttp does not support nt authentication from looking at the code. if you open a jira we can get it added and have a patch available.

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

michael_kalika — Thu, 24 Nov 2016 04:13:07 GMT

done! thank you very much!

https://issues.apache.org/jira/browse/NIFI-3096

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

knarayanan — Thu, 01 Dec 2016 12:23:53 GMT

I have done the needed code changes. Unfortunately i do not have a way to test this. If i sent you the NAR with the code change, would you be able to test it. Basically, just swap out the nifi-standar-nar-x.x.x from the lib, with the one i send you. Please test it on a local, non-prod instance.

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

rich_midwinter — Mon, 31 Jul 2017 21:56:53 GMT

Any chance you could send me your patched library? I'd be interested in the diff too.

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

rich_midwinter — Tue, 01 Aug 2017 15:56:16 GMT

Don't worry. Rolled my own, seems to work for me.

Re: Issues with GetHttp and NTLM authentication in NiFi,Consuming HTTP API with NTLM auth doesn't work

marcusmattson1 — Thu, 16 Nov 2017 21:06:17 GMT

I haven't seen any movement on the jira for a while. I am interested in the alternative nar. If you still need some testing of it, I am able to help.