About ebythomaspanick

ebythomaspanick · ‎01-07-2019

I could see couple of articles suggesting that swappiness setting must be set to 0 and in some cases, a value less than 10. Is there any new reccomendation for the swappiness setting for improved performance?

ebythomaspanick · ‎08-18-2018

If the node is brought back online with a new drive put instead of the failed one and the services started, will it cause any issues to the existing data that is on the cluster and has changed?

ebythomaspanick · ‎08-18-2018

I have couple of worker datanodes with multiple drive mount points in each for hdfs. One of these mountpoints failed and took place when the cluster was offline. To avoid any problems, the cluster was brought up without starting the ambari-agent or the other services on this node with the failed mount point back online. I was wondering what is the best way to reintegrate this node back to the cluster. Will there be any issues or dataloss if only the failed mount point is replaced and the the ambari-agent and other services on the node are started up? Or is there any particular approach to follow?

ebythomaspanick · ‎08-02-2018

Hi, Thanks for your response. The database is Oracle. The estimated latency for any communication(request or response) between the server and the database is 8ms. Is the Server Performance a factor for the nodes or does it include communication with Ambari database also?

ebythomaspanick · ‎08-01-2018

We have a databse migration planned where the latency bertween the database and cluster is estimated to be around 8ms. Is there a threshold for latency with respect to Ambari database?

ebythomaspanick · ‎06-26-2018

Hi Geoffrey, Thanks for your answer. So there's no issue if the agents are unable to report their status to the server? I was wondering if the nodes would be out of sync somehow since it's unable to communicate with the server and ingorm it's alive.

ebythomaspanick · ‎06-26-2018

Hi, Probably a noob query! I wanted to know if there was any real impact on a functioning cluster if the ambari-server service is stopped. Say for example all the services like Yarn, HBase, etc are running and there are multiple jobs based of spark or flink running on the cluster and the ambari-server is stopped. Other than the cluster monitoring not a possibility, does it really affect the execution of Flink/Spark jobs or the ability to access data from HDFS or HBase?

ebythomaspanick · ‎04-30-2018

Recently I upgraded my Ambari cluster's server and agent from v2.5.0.3 to v2.5.2.0. I have also performed schema upgrade using ambari-server upgrade Following this I can see that I get the following alert for the worker nodes in my cluster hdp-select could not properly read /usr/hdp. Check this directory for unexpected contents. ERROR: Unexpected file/directory found in /usr/hdp: hadoop I see that yarn.nodemanager.local-dirs and yarn.nodemanager.log-dirs contains path /usr/hdp/hadoop/yarn/local and /usr/hdp/hadoop/log respectively. These alerts have surfaced only after the upgrade was performed. Any idea what might be the issue? Thanks in advance.

Online	Offline
Last Visited	‎01-07-2019 01:57 PM

Date Registered	‎04-30-2018 01:15 PM
Last Visited	‎01-07-2019 01:57 PM
Total Messages Posted	8

What is the latest recommendation for swappiness?

Re: Drive failure for Datanode

Drive failure for Datanode

Re: How much latency can the Ambari database have?

How much latency can the Ambari database have?

Re: Ambari Server Impact

Ambari Server Impact

hdp-select Issue post upgrade