About andrewg

andrewg · ‎10-23-2015

Consider the following flow where records are inserted in the RDBMS (or Phoenix/HBase in this instance): The PutSQL and similar processor depends on a database connection, provided by a DBCPConnectionPool controller service (Controller Settings -> Controller Services): The best part: when one creates a template, all linked services will automatically be included. When template is rehydrated in another NiFi instance, services like the one below will automatically be added to the new NiFi flow:

andrewg · ‎10-23-2015

Slider is a client lib and will be installed as part of client set in Ambari. Whether you choose to install it on a master node, is secondary, but typically you will see Slider (and clients) on the edge nodes.

mpayne · ‎11-16-2015

@Andrew Grande - the good news is that in the next version NiFi and HDF, the swapping has been refactored quite, so the comment about having to adjust the nifi.queue.swap.threshold property will no longer be needed.

abajwa · ‎10-26-2015

I'm surprised it wasn't @bbende@hortonworks.com who wrote this article 😉

andrewg · ‎10-19-2015

No, there's a lot more going on under the hood and Ambari Agent is required for operations. Essentially, bring a node into a cluster (agent is installed) and provision only the services desired (e.g. only Knox).

andrewg · ‎10-27-2015

For the record, this made it into the 0.4.0 release now. Thanks everyone!

JoeWitt · ‎10-16-2015

There is no such alerting at this time. We do flag when expiration is set on connections and we've discussed extending that to include when backpressure is set but we don't have that now. We've also talked about actually signaling when expiration and/or backpressure are actually happening through the UI and of course the REST api but we've not done it yet. I think a good first approach would be a passive mechanism whereby we expose the fact of backpressure or expiration through the REST API so polling clients could know it (including our UI).

bbende · ‎07-07-2017

In Apache NiFi 1.2.0 and 1.3.0 (HDF 3.0.0) there is a ConvertRecord processor that can convert between any combination of Avro, JSON, and CSV.

sameer_khanwalk · ‎09-21-2016

Hi, Is there any way where we can trigger ListSFTP based on some status condition. Say ListSFTP should pick or transfer files based on some status. for example if status is start it should start fetching files and if it something else then it should stop.

apiri · ‎10-13-2015

They are not currently. We had evaluated this before, but generally available nightly builds and their ilk are not allowed according to guidelines [1]. Setting this up for a strictly developer capacity provided in "limited" dissemination to the developer mailing list seems to be okay but is not something we had pursued further at the time with Apache infrastructure. [1] http://www.apache.org/dev/release.html

Online	Offline
Last Visited	‎11-29-2021 04:12 PM

Member Since	‎07-30-2019 11:14 AM
Last Visited	‎11-29-2021 04:12 PM
Posts	333
Kudos received	329

Cloudera Community

Re: getfile : nifi does not have sufficient permi...

Re: Back pressure settings not Honored when a Funn...

Re: Urgent need for ListSFTP & FetchSFTP working e...

Re: Raise alert from NiFi if file not available fr...

Re: NiFi: PutHiveQL reflect UDF not working

Tip: Templates with Dependent Controller Services

Re: What node(s) should Slider be installed on for...

Re: MergeContent Processor Inner Workings

Re: Tip: Bend those Connections

Re: Add host to Ambari Alerts group that is not ma...

Re: Capture the Download event in provenance?

Re: Is there an event fired when Backpressure is e...

Re: Pattern: convert CSV to JSON?

Re: NiFi - How to use the GetSFTP processor withou...

Re: Are their NiFi nightly builds published anywhe...