Hello, We had a problem with one of our node's mainboard and it was changed. As we re-opened the node ambari agent could not connect to ambari server with below error: INFO 2018-12-27 16:59:24,790 NetUtil.py:70 - Connecting to https://master01:8440/ca ERROR 2018-12-27 16:59:24,797 NetUtil.py:96 - EOF occurred in violation of protocol (_ssl.c:618) ERROR 2018-12-27 16:59:24,797 NetUtil.py:97 - SSLError: Failed to connect. Please check openssl library versions. Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details. WARNING 2018-12-27 16:59:24,797 NetUtil.py:124 - Server at https://master01:8440 is not reachable, sleeping for 10 seconds... My humble guess is that old keys were not accepted by ambari server with new hardware. Guys who installed the mainboard says they updated the seriel with the old one. How can I get back this node? Is there any way to renew keys? PS: There are no files in path /var/lib/ambari-agent/keys/ Thanks in advance. ... View more

My team needs Spark v2.3 for new features. We have HDP 2.6.3 installed which has Spark 2.0 (Correction:2.2.0) within stack. Is that enough to comply such version requirement if I use a docker container as Spark Driver which has Spark 2.3 and configure it so as to use Yarn of current HDP installation? Or do i need all workers Spark 2.3 installed? The thing I need to understand is does workers (or nodemanagers) need new Spark libraries once job is submitted to Yarn? Following note in Spark Cluster overview page led me to think it may not be mandatory: "The user's jar should never include Hadoop or Spark libraries, however, these will be added at runtime." Thanks in advance... ... View more

Hello, I am having an issue with /tmp/hive/tmp directory: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.FSLimitException$MaxDirectoryItemsExceededException): The directory item limit of /tmp/hive/hive is exceeded: limit=1048576 items=1048576 With a short search i find out that it is a setting with parameter "dfs.namenode.fs-limits.max-directory-items" which is in hdfs-default.xml file. However it is not available for Ambari. Which file should I update? What is the right path? Should i update it on both hosts for HA mode? ... View more