Member since
05-16-2016
76
Posts
44
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1821 | 03-10-2016 08:52 PM |
04-16-2021
04:19 PM
Can you help to provide more insight on how we can able to achieve this? Thank you Srinu
... View more
10-17-2016
03:52 AM
Sunile. For daemons such as NM and RM, I can hard-code JMS port number. However, how to set different JMX port number on a number of JVM containers running on the same slave node? For example, I can configure 18 container per node, how could I set the port number to 8001-8018? Maybe I can use ZK, or some kind of script.
... View more
05-14-2018
09:03 AM
@mqureshi What if I set up 4 zookeeper node? The quorum would be ceil (4/2) = 2, but shouldn't it be 3 (n+1)/2.
... View more
08-29-2016
02:58 PM
Hi @ScipioTheYounger Yes - you are correct (StorageBasedAuthorizationProvider and DefaultHiveMetastoreAuthorizationProvider) are the two provided https://cwiki.apache.org/confluence/display/Hive/Storage+Based+Authorization+in+the+Metastore+Server DefaultHiveMetastoreAuthorizationProvider = Hive's grant/revoke model StorageBasedAuthorizationProvider = HDFS permission based model (which is recommended on the apache website) More info here on configuring for the storage-based model https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_Sys_Admin_Guides/content/ref-5422cb60-d1d5-425a-b719-ec7bd03ee5d3.1.html
... View more
07-28-2016
04:57 PM
6 Kudos
The flow you see in the UI comes from the conf directory flow.xml.gz, unrelated to the H2 database. If you installed two NiFi instances you should have two completely separate directories like /opt/nifi1 and /opt/nifi2, each with their own conf sub-directories, each with their own flow.xml.gz. If you had an existing NiFi instance with a flow, and then copied that directory to nifi2, it would start with the same flow, but from there if you made changes to either they should be separate.
... View more
07-28-2016
08:06 PM
@ScipioTheYounger here is example with ktutil
ktutil read_kt keytab1 read_kt keytab2 write_kt keytab.merge quit thanks @Laurent Edel
... View more
07-25-2016
03:51 PM
In general many users can share the same instance (these are not the same as OS users). In the NiFi 0.x baseline (HDF 1.2) users can have roles and roles can restrict what users can do. For example, a monitor can get a read only view of the UI and a data flow manager can change anything they want. In NiFi 1.x (HDF 2.0, not yet released) there will be a much finer grained security model where policies can be created for anything on the canvas to give specific users or groups access to an individual component (processor, process-group, etc.). A keytab is a file on the operating system controlled by the standard operating system file permissions. If the NiFi process is running as an operating system user that can access that keytab file, then any NiFi user can go into the UI and create a PutHDFS processor and type in the path to that keytab, because its not based on the user accessing NiFi, its based on the OS user NiFi is running as. The only way I could see preventing this was if files/keytabs could be defined as some kind of first-class resource in NiFi, and then policies could be created to limit which NiFi users could use those resources.
... View more
07-20-2016
10:15 PM
1. A retry file will be created when a retry is needed and be deleted after a retry finishes. 2. Graph storage file will record all the entities and instances to provide search and lineage information. It will grow as you create entities. The space complexity will be linear to the total number of entities and instances, assuming their dependency relations are sparse.
... View more
07-11-2016
06:35 PM
I don't think it works. Tried with /hdfsDataLocation only, retention doesn't work.
... View more
07-11-2016
03:42 PM
1 Kudo
Pretty sure its a community feature and not supported yet even if it should have found its way into the release. Also its very limited right now. Can you really replace your scheduling with it? It still seems to need a bit of time in the oven.
... View more