problem generating keytab with HTTP SPN

[#1]

hello cloudera community,

we are trying to create a keytab with the main one:

"HTTP/hostname@DOMAIN.LOCAL"

with the command:

ktpass -princ HTTP/hostname@DOMAIN.LOCAL -mapuser livy-http -crypto ALL -ptype KRB5_NT_PRINCIPAL -pass password2022 -target domain.local -out c:\temp\livy-http.keytab

but I try to validate the ticket with this keytab returns the error:

Exception: krb_error 24 Pre-authentication information was invalid (24) Pre-authentication information was invalid

KrbException: Pre-authentication information was invalid (24)
at sun.security.krb5.KrbAsRep.<init>(Unknown Source)
at sun.security.krb5.KrbAsReqBuilder.send(Unknown Source)
at sun.security.krb5.KrbAsReqBuilder.action(Unknown Source)
at sun.security.krb5.internal.tools.Kinit.<init>(Unknown Source)
at sun.security.krb5.internal.tools.Kinit.main(Unknown Source)
Caused by: KrbException: Identifier doesn't match expected value (906)
at sun.security.krb5.internal.KDCRep.init(Unknown Source)
at sun.security.krb5.internal.ASRep.init(Unknown Source)
at sun.security.krb5.internal.ASRep.<init>(Unknown Source)
... 5 more

this user "livy-http" is already created in AD and with the SPN "HTTP/hostname@DOMAIN.LOCAL" attached to it

what are we doing wrong?

[#2]

Hi sir,
This command is probably better to be evaluated in an AD forum, It is a power shell command in the AD server. Based on the stack trace you are getting, the pre-authentication is failing. Normally, this may happen because the account is enabled with pre-auth or you are using a cipher that requires pre-auth [0]

We can try to create by using only legacy ciphers:

##########################################
# How to Create a keytab from client application
##########################################

# Step 1: Type ktutil to enter prompt:
ktutil

# Step 2: At the ktutil prompt, add the authentication command below:
ktutil:  add_entry -password -p livy-http@DOMAIN.LOCAL-k 1 -e arcfour-hmac-md5

# Step 3: Type password
Password for livy-http@DOMAIN.LOCAL:

# Step 4: Create Keytab file at ktutil prompt:
# ktutil:  <command below to create keytab file>
wkt livy-http.keytab

# Step 5: Type quit to exit
quit

# Step 6: Verify Keytab Works Using kinit:
/usr/bin/kinit -V -kt livy-http.keytab livy-http@DOMAIN.LOCAL

[0] refer to the box checks "Do not required Kerberos Preauthentication":  https://docs.informatica.com/data-integration/powercenter/10-2/security-guide/kerberos-authenticatio...

[#3]

hi@JQUIROS ,

should "kutil" command be run on cluster host or AD host?

[#4]

hi @JQUIROS 

if create another keytab with the SPN below:

"livy-http/hostname@DOMAIN.LOCAL"

works, no problems.

the problem is when using HTTP

[#5]

In regards to your first question, it is on the cluster host.

For your second, We only create the keytab against the service SPN ("livy-http/hostname@DOMAIN.LOCAL"), what is the business purpose to create the keytab with HTTP principals? The service is authenticating against Service Principals, not HTTP.

[#6]

hi @JQUIROS 

we need to create the HTTP SPN keytab to use in the Livy service, as described in the link below:

https://enterprise-docs.anaconda.com/en/latest/admin/advanced/config-livy-server.html 

in the link above, kadmin was used, but we don't have kadmin but AD.

[#7]

ktpass might be purely AD, might be worth it to open an AD case if that is the only option.

Otherwise, Could you please try to create the keytab with the following ktutil commands:
add_entry -password -p HTTP@FQDN_DOMAIN.LO -k 1 -e arcfour-hmac-md5

[#8]

hi @JQUIROS 

using the ktutil command it was possible to create the principal:

HTTP/hostname@DOMAIN.LOCAL

how to export keytab now?

[#9]

hi @JQUIROS 

we were able to export the keytab with the command:

write_kt http.keytab

but when validating the ticket with the command:

kinit -kt http.keytab HTTP/hostnamae@DOMAIN.LOCAL

got the same error:

kinit: Preauthentication failed while getting initial credentials

[#10]

Hi @yagoaparecidoti,
The error is coming directly from the Active Directory KDC, please limit the keytab to RC4 HMAC as commented earlier. Scroll up on the first post.
Then, try to kinit by using the trace to understand the issue better:

KRB5_TRACE=/dev/stdout kinit -kt http.keytab HTTP/hostnamae@DOMAIN.LOCAL

[#11]

hi @JQUIROS 

the command to create the entry was:

add_entry -password -p HTTP/hostname@DOMAIN.LOCAL -k 1 -e rc4-hmac

then export the keytab with the command:

wkt http.keytab

and then to validate the tiker the command:

KRB5_TRACE=/dev/stdout kinit -kt http.keytab HTTP/hostname@DOMAIN.LOCAL

presented the error:

Getting initial credentials for HTTP/hostname@DOMAIN.LOCALLooked up etypes in keytab: rc4-hmac
Sending unauthenticated request
Sending request (237 bytes) to DOMAIN.LOCAL
Sending initial UDP request to dgram 172.22.22.22:88
Received answer (229 bytes) from dgram 172.22.22.22:88
Response was from master KDC
Received error from KDC: -1765328359/Additional pre-authentication required
Preauthenticating using KDC method data
Processing preauth types: PA-PK-AS-REQ (16), PA-PK-AS-REP_OLD (15), PA-ETYPE-INFO2 (19), PA-ENC-TIMESTAMP (2)
Selected etype info: etype rc4-hmac, salt "", params ""
Retrieving HTTP/hostname@DOMAIN.LOCAL from FILE:http.keytab (vno 0, enctype rc4-hmac) with result: 0/Success
AS key obtained for encrypted timestamp: rc4-hmac/20C1
Encrypted timestamp (for 1661441475.76781): plain 301AA011199992303232BED, encrypted 3625254347B405C2739999992C5C50F451C0A477AE3AD421DF
Preauth module encrypted_timestamp (2) (real) returned: 0/Success
Produced preauth for next request: PA-ENC-TIMESTAMP (2)
Sending request (313 bytes) to DOMAIN.LOCAL
Sending initial UDP request to dgram 172.22.22.22:88
Received answer (196 bytes) from dgram 172.22.22.22:88
Response was from master KDC
Received error from KDC: -1765328360/Preauthentication failed
Preauthenticating using KDC method data
Processing preauth types: PA-ETYPE-INFO2 (19)
Selected etype info: etype rc4-hmac, salt "", params ""
kinit: Preauthentication failed while getting initial credentials

[#12]

We need to reach out the AD support, the response is coming from the AD 

Response was from master KDC
Received error from KDC: -1765328360/Preauthentication failed
Preauthenticating using KDC method data
Processing preauth types: PA-ETYPE-INFO2 (19)
Selected etype info: etype rc4-hmac, salt "", params ""
kinit: Preauthentication failed while getting initial credentials

[0] Reference: https://docs.microsoft.com/en-us/openspecs/windows_protocols/ms-kile/ae60c948-fda8-45c2-b1d1-a71b484...

[#13]

@yagoaparecidoti 

What do you need the keytab with the HTTP principal for?

André

[#14]

hi @araujo 

to use in the livy service, as requested in the processes in the links below:

https://danielfrg.com/blog/2018/08/spark-livy/
https://enterprise-docs.anaconda.com/en/latest/admin/advanced/config-livy-server.html

[#15]

@yagoaparecidoti ,

The problem is that to generate a keytab for any principal you need to know the password for that principal. The HTTP/hostname principal probably already exists in your AD and has some unknown password. Without knowing that you would have to reset the principal password to be able to create a keytab for it. And if you reset its password you will invalidate any keytabs that already exist for that principal that other services may be using.

Cheers,

André

[#16]

hi @araujo 

the ad has two users:

livy

livy-http

the user livy has the SPN:

livy/hostname@DOMAIN.LOCAL

and it is working without problem in kinit

the user livy-http has the SPN:

HTTP/hostname@DOMAIN.LOCAL

but it is showing the error described above

[#17]

@yagoaparecidoti ,

Do you know the passwords for the users livy and livy-http? Can you manually kinit with those 2 users from the command line?

Can you also check in AD what's the value for userPrincipalName property of those two users and share it here?

Cheers,

André

[#18]

hi @araujo 

yes, we know the passwords, because we created these two users from scratch

before creating the keytabs for the two users, we managed to kinit the two users without problem "kinit user", after creating the keytabs for the two users, kinit only works with the keytab, but it only works on the livy user, when we try to run kinit in livy-http user keytab displays the error "kinit: Preauthentication failed while getting initial credentials"

the userprincipalname of each user is:

livy:
livy/hostname_livy_server@DOMAIN.LOCAL

livy-http:
HTTP/hostname_livy_server@DOMAIN.LOCAL

[#19]

The names you listed are the servicePrincipalName. These are different from the userPrincipalName. Could you please check the latter and let me know what they are?

Cheers,

André

[#20]

Could you please run the kinit commands for both accounts and share a screenshot showing the command line and the output?

[#21]

hi @araujo 

the userPrincipalName of user livy is:

livy/hostname_livy_server@DOMAIN.LOCAL

the userPrincipalName of the livy-http user is:

livy-http@DOMAIN.LOCAL

running the command "kinit livy":

running the command "kinit livy-http":

running the "kinit" command with the keytab created for user livy:

running the command "kinit" with the keytab created for the user livy-http:

we've been facing this problem for months, we haven't found the solution yet.