Member since
01-19-2017
3682
Posts
633
Kudos Received
373
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1742 | 06-04-2025 11:36 PM | |
| 2177 | 03-23-2025 05:23 AM | |
| 1039 | 03-17-2025 10:18 AM | |
| 3975 | 03-05-2025 01:34 PM | |
| 2713 | 03-03-2025 01:09 PM |
11-06-2019
12:42 PM
@svasi I saw a couple of potential issues and I would like you to make a few changes. Recreate an admin for Kerberos Using the below syntax # kadmin.local -q "addprinc admin/admin" ----------start of output--------- Authenticating as principal root/admin@EDHDEV.COM with a password. WARNING: no policy specified for admin/admin@EDHDEV.COM; defaulting to no policy Enter the password for principal "admin/admin@EDHDEV.COM": welcome1 Re-enter password for principal "admin/admin@EDHDEV.COM": welcome1 Principal "admin/admin@EDHDEV.COM" created. ----------end of output--------- Validate the principal works # kadmin -p admin/admin@EDHDEV.COM It will ask for the password once successfully authenticated then type q to quit Can you leave the default encryption types? and you should select Manage krb5.conf through Cloudera Manager Don't change the kadm5.acl file it's okay the way it is !! I saw something missing in your krb5.conf between [realms] and [logging] the domain_realm add that to all the hosts if it's a multinode [realms] EDHDEV.COM = { kdc = master-1.dev.edl.gcp.domain.it admin_server = master-1.dev.edl.gcp.domain.it } [domain_realm] .edhdev.com = EDHDEV.COM edhdev.com = EDHDEV.COM [logging] kdc = FILE:/var/log/krb5/krb5kdc.log admin_server = FILE:/var/log/krb5/kadmind.log default = SYSLOG:NOTICE:DAEMON Go to the CM and launch the kerberization using this below the principal admin/admin@EDHDEV.COM Please make the above changes restart the kdc and retry kerberization it should go smoothly Happy hadooping
... View more
11-06-2019
11:37 AM
@neha_t_jain Do you still need more clarification or did the response give you a good idea on how to proceed? I think if you plan to test drive HDP that's the only solution not to compromise your network security. Please let me know.
... View more
11-06-2019
11:30 AM
@m4x1m1li4n To validate the zookeeper ports can you run the snippets and share the output, it seems CDH uses the port 4181 for its zookeeper I am from the HDP world! Using port 2181 echo "stat" | nc server.example.org 2181 | grep Mode $ telnet slave3.sysdatadigital.it 2181 Using port 4181 echo "stat" | nc slave3.sysdatadigital.it 4181 | grep Mode $ telnet slave3.sysdatadigital.it 4181 Disable the firewall in the VPC which is a subnet doesn't disable the firewall on the host please validate that all the hosts have the firewall disable Assuming you are on Centos/RHEL 7 and share the output readapt if your OS is different # systemctl status firewalld From your CM can you share the zookeeper screenshot
... View more
11-06-2019
09:39 AM
@svasi Can you explain one cannot guess with the information you have given. HDP or CDH? OS Steps executed Krb5.conf Kdc.conf kadm5.acl Error log or screenshot. With the above the problem could be easier to analyze
... View more
11-05-2019
11:11 PM
@iamabug I now get you so yours is Ambari managed let me get back to you after testing
... View more
11-05-2019
10:35 PM
@m4x1m1li4n Was you cluster deployed using a cloudfornation template? Apart from that strange port can your hostname master.sysdatadigital.it resolve to the AWS IP? Remember its very trick with Internal and Public IP's because the hosts in the AWS datacenter need the internal IP's to communicate whilst the public IP is the accessible to the outside world. If you was to access and Cloudera service in AWS you will need to map your local hostname to the Public IP in AWS. The best solution for testing is to create a firewall inbound rule to only accept connections from you IP this is only good for testing and you should always harden your network security.
... View more
11-05-2019
12:09 PM
@iamabug I think it's a misconfiguration can you see the differences between these 2? The one in Black and BOLD is your current remove the ( = ) and replace it with a colon ( : ) and space after listener.security.protocol.map=SASL_PLAINTEXT:SASL_PLAINTEXT,EXTERNAL:SASL_PLAINTEXT [old] listener.security.protocol.map: SASL_PLAINTEXT:SASL_PLAINTEXT,EXTERNAL:SASL_PLAINTEXT [New] Restart the brokers and let me know if you still encounter the problem
... View more
11-05-2019
10:20 AM
@m4x1m1li4n I am wondering why your zookeeper is running on port 4181?? As shown in the log. Please check that the default zk port is 2181 after sorting that out restart the zookeeper ensemble 2019-11-05 16:05:48,449 WARN org.apache.zookeeper.server.quorum.QuorumCnxManager: Cannot open channel to 2 at election address slave3.sysdatadigital.it/13.53.62.160:4181 java.net.ConnectException: Connection refused (Connection refused) The default port for zookeeper is 2181 I have attached a screenshot of my zk see attached even if I had an assemble I would still have usually an FQDN:2181 slave3.sysdatadigital.it:2181,slave1.sysdatadigital.it:2181,slave2.sysdatadigital.it:2181 Can you ensure your Zookeeper assemble is up and running, down in the log too it seems you don't have an odd number of zookeepers in your case at least 3 Zookeepers to avoid the split-brain decision Happy hadooping
... View more
11-05-2019
09:00 AM
1 Kudo
@Harpreet_Singh No you will be fine Centos7 or RHEL no constraints just follow the official environment preparation instructions and dont overlook any point and I am sure you will be okay.
... View more