@nifideveloper, as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. ... View more

Convert the certificate from PEM to PKCS12 using openssl openssl pkcs12 -export -out keystore.p12 -in mydomain.crt Provide a strong password when prompted I don't know if it's a version issue but I only got the first instruction working adding the " -inkey mydomain.key"   openssl pkcs12 -export -inkey mydomain.key -in mydomain.crt -out keystore.p12   The rest of the article is great. Thanks for the explanation     ... View more

HI Bryan. end2end flow is: read from db ( nifi returns Avro format ) -> md5 selected columns -> convert to csv -> put to s3 I wanted to do md5 using groovy script using ConvertRecord . But I don't know how to start with a groovy script. Unitests didn't help me. If it is possible please share the example how groovy reads Avro data using ScriptedRecordReader) If my approach is wrong please suggest the better way. Thanks Oleg. ... View more

ConvertAvroToORC in Apache NiFi uses Apache Hive 1.2.1, which is not guaranteed to be compatible with any Hive 2.x release, although it's nice to know that it works fine with 2.1.X. The NiFi in Hortonworks Data Flow (HDF) uses HDP Hive, which is 1.2.1 plus many additions. This is also not guaranteed to be compatible with any Hive 2.x release, but it may just happen to work for you. In the future, I presume there will be a set of Hive/ORC processors that use Hive 2.x rather than Hive 1.x. However, an Apache NiFi release will still be using Apache Hive / Apache ORC libraries, so it still might not work with a vendor-specific version of Hive. Again the exception is HDF NiFi, which supports HDP Hive. ... View more

@Oleg Ruchovets Hi Oleg, I have a similar situation. I am loading an orc formatted file into HDFS to which the Hive table's Location is pointing to. In my case not all my values are null, If there are 33 files in the hdfs location where I stored it as orc format, I see 33 rows with data in the Hive table but I also see another 10 rows where all null in the hive table. Have you found a solution for your issue yet. ... View more

No, this is not going to work as you want it to. A client will randomly pick a ZooKeeper server from the list provided. This is how ZooKeeper works -- you cannot change this logic. You will need to implement your own logic that controls when clients use the Master cluster and when they use the DR cluster. ... View more

Hi @Oleg Ruchovets Please don't mix OS versions on a single cluster, it'll very likely get you into some serious issues down the line, it also wouldn't be a supported scenario from a Hortonworks Support perspective if that's important to you unless it happened as part of a rolling OS upgrade across a single cluster. ... View more