Member since
05-16-2016
76
Posts
44
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1881 | 03-10-2016 08:52 PM |
07-28-2016
04:45 PM
1 Kudo
I installed NIFI in two separate location nifi and nifi2 with different ports - one without kerberized ZK and one with kerberized ZK. However, both web UI (8080 and 9080) see the same nifi flow graphs. How could they share the same internal database such as H2?
... View more
Labels:
- Labels:
-
Apache NiFi
07-27-2016
04:53 PM
Yes. However, we use adkeytab from Centrify. Here is a blog on this (he used adkeytab to add spn and kutil to merge with no detailed steps). https://www.centrify.com/activate/cmz3c60glnnmc1tnlwnv0srcpkfct5p9/
... View more
07-27-2016
04:29 PM
http://community.centrify.com/t5/Centrify-Insight/Difference-between-adkeytab-and-ktutil/td-p/14281 Did you use ktutil to merge?
... View more
07-26-2016
03:25 PM
Thanks Sunile. We got that already. This is for adding two principals in the same key tab using AD, not MIT kdc.
... View more
07-26-2016
02:39 PM
Anyone knows how to do with AD adkeytab command? https://community.hortonworks.com/articles/35019/oozie-ha-configuration-with-kerberos.html step 8 requires to add more than more principals in the same keytab.
[root@kk2 ~]# klist -ket /etc/security/keytabs/spnego.service.keytab Keytab name: FILE:/etc/security/keytabs/spnego.service.keytab KVNO TimestampPrincipal ----------------------------------------------------------------------------- 305/03/1616:44:05 HTTP/kk2.hwxblr.com@HWX.COM (aes256-cts-hmac-sha1-96) 305/03/1616:44:05 HTTP/kk2.hwxblr.com@HWX.COM (aes128-cts-hmac-sha1-96) 305/03/1616:44:05 HTTP/kk2.hwxblr.com@HWX.COM (des3-cbc-sha1) 305/03/1616:44:05 HTTP/kk2.hwxblr.com@HWX.COM (arcfour-hmac) 505/03/1616:44:11 HTTP/test1-ambari-server.hwxblr.com@HWX.COM (aes256-cts-hmac-sha1-96) 505/03/1616:44:11 HTTP/test1-ambari-server.hwxblr.com@HWX.COM (aes128-cts-hmac-sha1-96) 505/03/1616:44:11 HTTP/test1-ambari-server.hwxblr.com@HWX.COM (des3-cbc-sha1) 505/03/1616:44:11 HTTP/test1-ambari-server.hwxblr.com@HWX.COM (arcfour-hmac)
... View more
Labels:
- Labels:
-
Apache Oozie
07-25-2016
02:12 PM
Do you mean that each nifi user should have his/her own instance? There could be too many. Also is there any way to specify multiple instances per host?
... View more
07-20-2016
04:31 PM
Currently HDF 1.2 is running as user root. I am using HDP 2.3.2 so NIFI is not part of Ambari controlled list. Since it is run as root, getHDFS or putHDFS processor uses a user keytab. How could I prevent a user A to create a processor to use user B's keytab? In HDP 2.4 or later, do we have NIFI service user ID provisioned?
... View more
Labels:
- Labels:
-
Apache NiFi
07-20-2016
02:33 PM
There are three directories to be on NFS mount. Conf directory should not take much space. I checked retry directory and it was empty. Will it be automatically cleaned up? I checked graph storage and I had under 1 mb since I have only a few feeds. Will it keep growing as I add more feeds? How to get a good estimation on this? https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_data_governance/content/ch_appendix_data_gov_config_ha.html
*.retry.recorder.path: This location should be an NFS-mounted directory that is owned by Falcon, and with permissions set to 755. *.falcon.graph.storage.directory: This location should also be an NFS-mounted directory that is owned by Falcon, and with permissions set to 755. Falcon conf directory: The default location of this directory is <falcon_home>/conf, which is symbolically linked to/etc/falcon/conf. This directory must point to an NFS-mounted directory to ensure that the changes made on the primary Falcon server are populated to the back-up server.
... View more
Labels:
- Labels:
-
Apache Falcon
07-11-2016
06:35 PM
I don't think it works. Tried with /hdfsDataLocation only, retention doesn't work.
... View more
07-11-2016
04:14 PM
https://falcon.apache.org/EntitySpecification.html#Feed_Specification
<cluster name="test-cluster">
<validity start="2012-07-20T03:00Z" end="2099-07-16T00:00Z"/>
<retention limit="days(10)" action="delete"/>
<sla slaLow="hours(3)" slaHigh="hours(4)"/>
<locations>
<location type="data" path="/hdfsDataLocation/${YEAR}/${MONTH}/${DAY}/${HOUR}/${MINUTE}"/>
<location type="stats" path="/projects/falcon/clicksStats" />
<location type="meta" path="/projects/falcon/clicksMetaData" />
</locations>
</cluster> For location as data, do we have to specify the date format? Could I just have a general location as /hdfsDataLocation?
... View more
Labels:
- Labels:
-
Apache Falcon