@ZhouJun  I'd recommend upgrading your NiFi to the latest release as you may be hitting these related bugs: https://issues.apache.org/jira/browse/NIFI-9835 https://issues.apache.org/jira/browse/NIFI-9433 https://issues.apache.org/jira/browse/NIFI-9761 Thank you, Matt ... View more

Hi @karan_alang1    Good news. CDP is supported Spark with Atlas integration.   Note: In HDP it is experimental only.   References: 1. https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/atlas-reference/topics/atlas-spark-metadata-collection.html 2. https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-hdp/topics/amb-enable-spark-cm.html   ... View more

I made the same experience already end of August, however only when trying to deploy with Ambari 2.7.4 I created an issue in https://github.com/hortonworks/ansible-hortonworks/issues/166  (btw highly recommended way to use Ansible with those playbooks to deploy HDP, if you cannot use cloudbreak !) as I initially thought it might be a bug in those ansible playbooks. But it was clearly the problem that the provided HDF mpacks are incompatible with Ambari 2.7.4 (as can be seen from the Exception infos in the issue link above).   However the good news: I got a cluster deployed using latest HDP 3.1.4 and HDF 3.4.1.1, simply by using Ambari 2.7.3  (except I missed something, and I just thought that the newest versions were indeed used) ... View more

I did a quick research on why rhel7/centos7 still contains such an old mysql java connector/driver version (see "Redhat response"), and checked for working alternative RPMs (as installing via an rpm has many advantages vs a manual tarball install)   There are many working RPMs (I tested all of below, with CDH 6.2.0 and openjdk-8): - With Java >=v8, I recommend following: Ref: https://centos.pkgs.org/7/mysql-connectors-i386/mysql-connector-java-8.0.16-1.el7.noarch.rpm.html RPM: yum install http://repo.mysql.com/yum/mysql-connectors-community/el/7/i386//mysql-connector-java-8.0.16-1.el7.noarch.rpm   - With Java v7 you can try the latest 5.1.x from Fedora: Ref: https://fedora.pkgs.org/29/fedora-x86_64/mysql-connector-java-5.1.38-7.fc29.noarch.rpm.html RPM: http://download-ib01.fedoraproject.org/pub/fedora/linux/releases/29/Everything/x86_64/os/Packages/m/mysql-connector-java-5.1.38-7.fc29.noarch.rpm   - Find RPMs for other distros: https://pkgs.org/download/mysql-connector-java   - Official Redhat response: Alternatively, for Java-8, Redhat proposes to use the MariaDB client: https://bugzilla.redhat.com/show_bug.cgi?id=1684349#c7 > this is the best we could do for the customers who need a recent version of the JDBC driver for MySQL/MariaDB. More infos: https://developers.redhat.com/blog/2019/06/25/mariadb-10-3-now-available-on-red-hat-enterprise-linux-7/ For centos7: https://centos.pkgs.org/7/centos-sclo-rh-testing-x86_64/rh-mariadb103-mariadb-java-client-2.4.1-1.el7.noarch.rpm.html   I tested the 1-line yum install, but CDH would require more changes, due to the driver installed in /opt: yum install https://buildlogs.centos.org/centos/7/sclo/x86_64/rh/rh-mariadb103/rh-mariadb103-mariadb-java-client-2.4.1-1.el7.noarch.rpm https://buildlogs.centos.org/centos/7/sclo/x86_64/rh/rh-mariadb103/rh-mariadb103-runtime-3.3-3.el7.x86_64.rpm ... View more

I'm in same situation. Have you found any solutions to this problem? ... View more

@Jasper did you find a better solution, that to re-install (first HDP than HDF) ? Anyway AFAIU indeed it was/is not supported to start with an HDF cluster, and then add HDP (components), but only the other way around! ... View more