I have a small cluster running HDP 3.1.5.6091 with Ambari 2.7.5.0 the I inherited The Yarn Timeline service starts but gets a constant critical alert   ATSv2 HBase Application The HBase application reported a 'FAILED' state. Check took 2.261s   The hadoop-yarn-timelinereader.log shows  failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused:server.name:17020   I added that port (17020) to the firewall on the server in question, restarted the  Timeline Service V2.0 Reader service but still getting the same error.   Any suggestions would be appreciated       ... View more

I am running HDP-2.5.3.0, ambari 2.4.2.0 I have a cluster node/host that died over the weekend and I am not able to resurrect it Through ambari I am able to put it in maintenance mode.   I would like to delete this node from the cluster.  It's role was datanode and yarn Nodemanager. Went choosing the delete option for Host Actions I get a warning that the DataNode and Nodemanager should be decommissioned first to prevent loss but those options are not available via ambari.   Is there another option for decommissioning or is my only option to delete given the status of the node?  Thanks.  ... View more

Trying to get serde working with zeppelin and/or the spark shell. Running the following in either val links = sqlContext.sql("SELECT * FROM test_links LIMIT 10") links.show() Produces an error ERROR hive.log: error in initSerDe: java.lang.ClassNotFoundException Class org.apache.hive.hcatalog.data.JsonSerDe not found java.lang.ClassNotFoundException: Class org.apache.hive.hcatalog.data.JsonSerDe not found Tried added this to /etc/spark/conf/hive-site.xml <property> <name>hive.aux.jars.path</name> <value>file:///usr/hdp/2.5.3.0-37/hive2/lib/hive-hcatalog-core.jar</value> </property> But am still getting the error. ... View more

HDP 2.5.3 Ambari 2.4.2 18 data nodes 190TB HDFS disk usage is at about 92% ~15TB free with critical alarms or warnngs on most all the data nodes Percent DataNodes With Available Space is alarming as well Are the best practice recommendations for setting these thresholds, for managing the percent of HDFS disk usage? Are there concerns for running HDFS disk usage above a certain percentage? ... View more