In an upcoming release you'll be able to use Hive 1.1 processors, so in your case you'd want to keep what you have (Avro in HDFS) and use PutHive_1_1QL to issue a LOAD DATA or CREATE EXTERNAL TABLE statement so Hive can see your data. ... View more

Hi Matt, We are running HDF-2.1.2 planning to upgrade ASAP thanks for your anwser ... View more

Hello @Matt Burgess . I am using the CaptureChangesMysql processor to read the events data from mysql but it it failing with the connection error as "org.apache.nifi.reporting.initializationexception can't load database driver" screenshots are attached for the reference . Mysql Driver path: file:////Users/kiran/Downloads/mysql/mysql-connector-java-8.0.17.jar Environment : Aapache nifi :1.7.0 Mysql 8.0.17 OS : MacOS 10.14.4 ... View more

It looks like you are trying to connect via the Zookeeper port, but there are some issues with this: You'll likely have trouble because of the issue described in NIFI-2575. Even if that were not the issue, the following two things would have to be done. I believe you'd have to set some variables in the URL (such as serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2) The Zookeeper port is not exposed via the sandbox by default, you would have to forward that port if using NAT. For these reasons, I recommend you connect via the standard HiveServer2 port (10000), which is exposed by default for the sandbox's NAT configuration. ... View more

Do you mind putting this into a new HCC question? Although the problems may be somewhat similar, you will likely get answers that don't apply to the original question here, so to avoid confusion, I think a new question is the right way to go 🙂 Thanks in advance! ... View more

to me.. this is not the simple approach.. its very limiting and its no simpler than using the jolttransformation suggested above. ... View more

@Matt Burgess Thank you so much. ... View more

Dear @Matt Burgess what a luck ,yea it worked after upgrading to hdf3.0 Thanks a lot man:) Appreciated a lot ... View more

Try three slashes in the Database Driver Jar Url property: file:///post/postgresql-42.1.1.jar ... View more

Thanks Sonu Sahi ... View more