Member since
04-11-2016
471
Posts
325
Kudos Received
118
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2075 | 03-09-2018 05:31 PM | |
2640 | 03-07-2018 09:45 AM | |
2535 | 03-07-2018 09:31 AM | |
4398 | 03-03-2018 01:37 PM | |
2468 | 10-17-2017 02:15 PM |
06-20-2017
11:50 AM
1 Kudo
In regards to NiFi inside HDF 3.0, this is very stable and brings a lot of new great features. Regarding the new components coming with HDF 3.0 (SAM and Schema Registry), you might want to wait HDF3.1 to start using the components in a production environment (of course it depends what are your requirements).
... View more
06-20-2017
11:48 AM
Hi @mel mendoza, NiFi is I/O intensive and is requiring dedicated disks. It is not recommended to use the NiFi nodes for something else (at least for a production environment). Besides, for very high rates workflows it is also highly recommended to have dedicated nodes (and disks) for Zookeeper nodes.
... View more
06-20-2017
09:41 AM
3 Kudos
Hi Jody, The benefits are integration with Ranger for authorizations management ; configuration management and deployment with Ambari (if you have a NiFi cluster, no need to manually update the configuration files on all the nodes) ; integrated monitoring with AMS/Grafana. Please note that with Ambari 2.5.1.0 / HDP 2.6.1, it is possible to add the HDF management pack in the same Ambari to have both HDP and HDF components managed by the same Ambari and using the same common components (Ambari Infra, Zookeeper, Ranger, AMS, etc). https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.0.0/index.html#bk_installing-hdf-on-hdp Hope this helps.
... View more
06-20-2017
07:00 AM
Hi @Julio Cedeno, In nifi.properties, you have two properties for login authentication:
nifi.login.identity.provider.configuration.file=./conf/login-identity-providers.xml
nifi.security.user.login.identity.provider=ldap-provider The first one points to the file where you are defining your login identity providers. The second one must be the name of the login identity provider you want to use from the definition file. In your file, you must have something like: <loginIdentityProviders>
<provider>
<identifier>myProvider1</identifier>
<class>...</class>
<property name="...">...</property>
</provider>
<provider>
<identifier>myProvider2</identifier>
<class>...</class>
<property name="...">...</property>
</provider>
<loginIdentityProviders> The error you have is probably due to the fact there is no provider named "ldap-provider" in your configuration file. Are you sure you un-commented the content of the file? Hope this helps.
... View more
06-17-2017
04:14 PM
1 Kudo
Hi @Guna sun, You can use the format function: https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#now Example: ${now():format('yyyyMMdd-HHmmss')} I'd not recommend using the character ":" in file names. Hope this helps.
... View more
06-02-2017
12:13 PM
2 Kudos
You're right, ListenHttp cannot be used as I said... I was thinking about the use of HandleHttpRequest and HandleHttpResponse. With ListenHttp you cannot actually access multiple URLs. An example could be: https://pierrevillard.com/2017/01/31/nifi-and-oauth-2-0-to-request-wordpress-api/ Hope this helps.
... View more
06-02-2017
09:48 AM
1 Kudo
Hi @Simran Kaur, That's not possible. However you can do a single ListenHttp followed by a RouteOnAttribute that will route the flow files based on the requested URL (the attribute should be http.request.url). Hope this helps.
... View more
05-17-2017
08:42 AM
1 Kudo
Hi @Kiem Nguyen, Yes that's what you need to do: use a RPG pointing to the cluster itself. You might be interested by: https://pierrevillard.com/2017/02/23/listfetch-pattern-and-remote-process-group-in-apache-nifi Hope this helps.
... View more
04-21-2017
03:36 PM
1 Kudo
Also, you will probably be interested by a new feature currently in the review process in the Apache community: https://github.com/apache/nifi/pull/1676 https://issues.apache.org/jira/browse/NIFI-3709
... View more
04-20-2017
02:56 PM
Hi @Raphaël MARY, Did you set a different value for number of concurrent tasks? Are you in a cluster configuration?
... View more