Member since
01-19-2017
3681
Posts
633
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1619 | 06-04-2025 11:36 PM | |
| 2075 | 03-23-2025 05:23 AM | |
| 986 | 03-17-2025 10:18 AM | |
| 3758 | 03-05-2025 01:34 PM | |
| 2587 | 03-03-2025 01:09 PM |
11-06-2019
11:37 AM
@neha_t_jain Do you still need more clarification or did the response give you a good idea on how to proceed? I think if you plan to test drive HDP that's the only solution not to compromise your network security. Please let me know.
... View more
11-06-2019
11:30 AM
@m4x1m1li4n To validate the zookeeper ports can you run the snippets and share the output, it seems CDH uses the port 4181 for its zookeeper I am from the HDP world! Using port 2181 echo "stat" | nc server.example.org 2181 | grep Mode $ telnet slave3.sysdatadigital.it 2181 Using port 4181 echo "stat" | nc slave3.sysdatadigital.it 4181 | grep Mode $ telnet slave3.sysdatadigital.it 4181 Disable the firewall in the VPC which is a subnet doesn't disable the firewall on the host please validate that all the hosts have the firewall disable Assuming you are on Centos/RHEL 7 and share the output readapt if your OS is different # systemctl status firewalld From your CM can you share the zookeeper screenshot
... View more
11-06-2019
09:39 AM
@svasi Can you explain one cannot guess with the information you have given. HDP or CDH? OS Steps executed Krb5.conf Kdc.conf kadm5.acl Error log or screenshot. With the above the problem could be easier to analyze
... View more
11-05-2019
11:11 PM
@iamabug I now get you so yours is Ambari managed let me get back to you after testing
... View more
11-05-2019
10:35 PM
@m4x1m1li4n Was you cluster deployed using a cloudfornation template? Apart from that strange port can your hostname master.sysdatadigital.it resolve to the AWS IP? Remember its very trick with Internal and Public IP's because the hosts in the AWS datacenter need the internal IP's to communicate whilst the public IP is the accessible to the outside world. If you was to access and Cloudera service in AWS you will need to map your local hostname to the Public IP in AWS. The best solution for testing is to create a firewall inbound rule to only accept connections from you IP this is only good for testing and you should always harden your network security.
... View more
11-05-2019
12:09 PM
@iamabug I think it's a misconfiguration can you see the differences between these 2? The one in Black and BOLD is your current remove the ( = ) and replace it with a colon ( : ) and space after listener.security.protocol.map=SASL_PLAINTEXT:SASL_PLAINTEXT,EXTERNAL:SASL_PLAINTEXT [old] listener.security.protocol.map: SASL_PLAINTEXT:SASL_PLAINTEXT,EXTERNAL:SASL_PLAINTEXT [New] Restart the brokers and let me know if you still encounter the problem
... View more
11-05-2019
10:20 AM
@m4x1m1li4n I am wondering why your zookeeper is running on port 4181?? As shown in the log. Please check that the default zk port is 2181 after sorting that out restart the zookeeper ensemble 2019-11-05 16:05:48,449 WARN org.apache.zookeeper.server.quorum.QuorumCnxManager: Cannot open channel to 2 at election address slave3.sysdatadigital.it/13.53.62.160:4181 java.net.ConnectException: Connection refused (Connection refused) The default port for zookeeper is 2181 I have attached a screenshot of my zk see attached even if I had an assemble I would still have usually an FQDN:2181 slave3.sysdatadigital.it:2181,slave1.sysdatadigital.it:2181,slave2.sysdatadigital.it:2181 Can you ensure your Zookeeper assemble is up and running, down in the log too it seems you don't have an odd number of zookeepers in your case at least 3 Zookeepers to avoid the split-brain decision Happy hadooping
... View more
11-05-2019
09:00 AM
1 Kudo
@Harpreet_Singh No you will be fine Centos7 or RHEL no constraints just follow the official environment preparation instructions and dont overlook any point and I am sure you will be okay.
... View more
11-05-2019
08:36 AM
1 Kudo
@neha_t_jain As your company has stringent regulations about the Java version,unfortunately even HDP 3.1 hasn't been certified against java 11,my best bet if to take the golden opportunity to propose the deployment of the HDP cluster in the cloud AWS or Azure, and try to sell the advantage on the cloud offerings, this way the environment is isolated and the network admins can create VDI [Virtual desktops] in a specific VLAN or VM's in the cloud so user's access it through RDP remote desktop and only when HDP/CDP is certified against java 11 then access can be given to users in the corporate network. I am assuming you have only select users who are going to use the HDP cluster. HTH
... View more