Maybe you can combine these two for a failed job alert: “Configuring Custom Alert Scripts” “Configuring Log Alerts” My thought process is, that in the RM log, there is a very reliable pattern when a job fails (e.g. finalStatus=FAILED), so you could set up a Log Alert for that. ... View more

The certificate_unknown message is received as an alert from the caller initiating the TLS session.  Generally, that means that the client making a connection to the server did not trust the certificate.   To find out who is really not trusting the NameNode certificate, check anything that connects to the NameNode.  Mostly, it is the DataNodes who need to hearbeat in I think.  Check your DataNode logs to find out if you get exceptions regarding trust when they attempt to make a connection.  For Resource Manager, check the NodeMangers' logs too.   Once you have reviewed the logs, you will likely have a better idea of what is going on.   You mentioned that "/var/lib/hadoop-hdfs/certs" is your truststore.  If it is, it should contain the certificate for every host in your cluster.  Also, make sure you have configured a path to it in the Service Configuration in HDFS:   "Cluster-Wide Default TLS/SSL Client Truststore Location" ... View more

Thank you. ... View more

Hello,   You can do the following step:   Kafka > Instances (Select Instance) > Configuration > Kafka Broker > Advanced > Kafka Broker Advanced Configuration Snippet (Safety Valve) for kafka.properties   Please add (example):   listeners=PLAINTEXT://192.10.0.1:9092,PLAINTEXT://10.0.3.3:9092   Gabor ... View more

Yes, that works.  "CSD file" sounds like a text config file.  Adding a simple description that it's a JAR in the instruction page would have clarified.   Thanks again. Miles   ... View more

Hi, it works applying above configuration. But now i have a NullPointerException in my spark code (rdd.foreach): ...   kafkaStream.foreachRDD(new VoidFunction<JavaPairRDD<String, byte[]>>() { public void call(JavaPairRDD<String, byte[]> rdd) throws Exception { rdd.foreach(new VoidFunction<Tuple2<String, byte[]>>() { public void call(Tuple2<String, byte[]> avroRecord) throws Exception {   In local mode it works but not in yarn-cluster.   Do you have any ideas in order to get it running?   Best Regards,  Butkiz ... View more