Member since
07-21-2016
101
Posts
10
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4696 | 02-15-2020 05:19 PM | |
81862 | 10-02-2017 08:22 PM | |
1980 | 09-28-2017 01:55 PM | |
2182 | 07-25-2016 04:09 PM |
06-14-2018
08:05 AM
it's quite usual, that the DB servers are protected from access from the internet, and if your hadoop cluster is not in the company network, it is considered as being internet, so you security team will not allow access. You can discuss with your networks security team, if a VPN tunnel from your hadoop cluster to the sql server is possible, but in most cases, network security will require in that cases to apply all internal security standards on your hadoop cluster as well, as otherwise they are not considered as trustworthy. Another option is, if a SSH connection is allowed from the ms SQL server to your hadoop cluster, in that case you could tunnel the port 1433 as well to use it from hadoop. A common solution to this situation is also to migrate the hadoop cluster from a cloud location to a on premise installation.
... View more
04-24-2018
03:30 PM
@Jay Kumar Sensharma Thanks for your reply. Looks like there were stale alerts. All the alerts went away after I restarted the ambari agents
... View more
04-17-2018
06:54 PM
1 Kudo
@Kumar Veerappan Unfortunately YES your cluster won't function you will have to shutdown gracefully your cluster and wait for the patching to end. In an HDP HA setup the master nodes NN, RM should be on 2 distinct racks/switches Here are some considerations
Machines should be on an isolated network from the rest of the data center. This means that no other applications or nodes should share network I/O with the Hadoop infrastructure. This is recommended as Hadoop is I/O intensive, and all other interference should be removed for a performant cluster. Machines should have static IPs. This will enable stability in the network configuration. If the network were configured with dynamic IPs, on a machine reboot or if the DNS lease were to expire then the machine’s IP address would change, and this would cause the Hadoop services to malfunction. Reverse DNS should be set up. Reverse DNS ensures that a node’s hostname can be looked up through the IP address. Certain Hadoop functionalities utilize and require reverse DNS. Dedicated “Top of Rack” (TOR) switches to Hadoop Use dedicated core switching blades or switches Ensure application servers are “close” to Hadoop Consider Ethernet bonding for increased capacity All clients and cluster nodes require Network access and open firewall ports each of the services for communication between the servers. If deployed to a cloud environment, then make certain all Hadoop cluster Master and Data nodes are on the same network zone (this is especially important when utilizing cloud services such as AWS and Azure). If deployed to a physical environment, then make certain to place the cluster on in a VLAN. The Data node and Client nodes should at the minimum have a 2 x 1 Gb Ethernet a typically recommended Network controller is 1 x 10 Gb Ethernet. For the switch communicating between the racks, you will want to establish the fastest Ethernet connections possible with the most capacity. Hope that helps
... View more
10-10-2017
02:11 PM
@Kumar Veerappan You might also be interested to look at the : https://community.hortonworks.com/articles/54146/migrating-hue-to-ambari-views-24.html
... View more
09-28-2017
01:55 PM
Fount out that this is available in zkfc logs which will be present in the name node. For some reason these logs are not present in my name node boxes, so probably I need to restart the ZKFC services. Thanks Kumar
... View more
09-20-2017
06:50 AM
restarting ambari agents solved mine. service ambari-agent restart
sometimes you have to wait for a while for the ambari server to get update from agent.
... View more
04-14-2017
02:59 PM
@Kumar Veerappan
No, Maintenance Mode supports suppressing alerts and skipping bulk operations for specific services, components and hosts in an Ambari-managed cluster. You typically turn on Maintenance Mode when performing hardware or software maintenance, changing configuration settings, troubleshooting, decommissioning, or removing cluster nodes. You may place a service, component, or host object in Maintenance Mode before you perform necessary maintenance or troubleshooting tasks. Maintenance Mode affects a service, component, or host object in the following two ways: Maintenance Mode suppresses alerts, warnings and status change indicators generated for the object Maintenance Mode exempts an object from host-level or service-level bulk operations Explicitly turning on Maintenance Mode for a service implicitly turns on Maintenance Mode for components and hosts that run the service. While Maintenance Mode On prevents bulk operations being performed on the service, component, or host, you may explicitly start and stop a service, component, or host having Maintenance Mode On. Link Hope this helps you.
... View more