All processors run under the context of user that is running Nifi. Check authentication for the user running Nifi. ... View more

OR .collect()[0][1] ... View more

You will need machine names (DN) for both Nifi and Nifi Registry like "CN=machinename,...dc=example,dc=com" where in CN you will use server name the remaining portion will come under whatever wildcard (sub)domain you have. Then you will enter the full DN, manually as a user in both Nifi and Nifi Registry. This method is similar to when setting up site-to-site policies here: https://community.hortonworks.com/articles/88473/site-to-site-communication-between-secured-https-a.html Finally, you can check logs files for errors when pulling buckets in both Nifi and Nifi registry in files *-app.log and *-user.log, this may as well give you a full DN Nifi is looking for. ... View more

In client mode your jar is running on edge node or local machine which will have smtp connectivity. In cluster mode, any of the data nodes could run your jar, so you will need to check connectivity to smtp from all nodes. ... View more

Have a look at this if you need to by pass Avro for Hive DDL: https://github.com/tspannhw/nifi-convertjsontoddl-processor If you need to convert JSON to ORC (for Hive) Avro will be required. You will need to write/manage Avro schemas (recommended will be to use Schema Registry for that). Alternatively you can use Infer Avro schema to detect incoming schema from JSON but it may not be 100% correct all the time. ... View more

If I remember correctly, you will need to add Nifi Registry Server DN (SSL machine name) to Nifi > Access Policies and Nifi Server DN to Nifi Registry to be able to read and query buckets. Once they both know each other, buckets will load. ... View more

If users and groups are deleted in openLDAP server you should use 'existing' mode with ambari ldap sync: ambari-server sync-ldap --existing https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-security/content/existing_users_and_groups.html ... View more

Perhaps: "Reading/writing to an ACID table from a non-ACID session is not allowed. In other words, the Hive transaction manager must be set to org.apache.hadoop.hive.ql.lockmgr.DbTxnManager in order to work with ACID tables." SET hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Limitations ... View more

Following call we do, if kafka does not exist you will get status 404. curl --user admin -sS -G "http://ambari_server_here/api/v1/clusters/CLUSTERNAME_HERE/services/KAFKA" API resource: https://github.com/apache/ambari/blob/trunk/ambari-server/docs/api/v1/index.md ... View more

Query Record Processor in this scenario seems a bit of overkill for this problem. And will require more work if you don't have auto incrementing fields. You can use just SplitText processor to do everything. https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.5.0/org.apache.nifi.processors.standard.SplitText/index.html ... View more