Hi, For anyone still wondering about this warning, it can be solved by updating Metron Client version in ambari db running on your Ambari server host. Assuming postgres is used, you can find the DB port by running following one-liner: PID=`ps -eaf | grep "postgres: ambari" | grep -v grep | awk '{print $3}' | uniq`; netstat -anp | grep $PID | grep PGSQL | tail -1 | awk '{print $NF}' | rev | cut -d'.' -f 1 | rev  Default is: 5432 Connect to DB on given port (default password for ambari user is 'bigdata'): psql ambari -U ambari -W -p 5432 Find out what version does your Ambari expect (it should be your HDP version): select version from hostcomponentstate where current_state='STARTED' and version NOT LIKE 'UNKNOWN' limit 1; Check if the current Metro Client version is indeed 'unknown': select * from hostcomponentstate where component_name='METRON_CLIENT'; Update Metron Client version with the version returned by the first query: update hostcomponentstate set version = '2.6.5.1100-53' where component_name = 'METRON_CLIENT'; Restart Ambari server so it can pick up on changes ambari-server restart After the server is up and next check passes (default is every 5 minutes) the warning should clear out ... View more

Hi,    Based on the documentation [1], we notice that the HDP -2.6.5 already has Apache Spark 2.3.2 in it.  We recommend upgrading HDP stack so that you can get an appropriate version of spark which comes with stack instead of manually installing spark.   [1] https://docs.cloudera.com/HDPDocuments/HDPforCloud/HDPforCloud-2.6.5/hdp-release-notes/content/hdp_comp_versions.html ... View more