@ushasri I believe the solution here is to use the Record based processors with a specified schema.  This allows you to provide the correct schema to the Reader and the Writer regardless of the field names in original excel data source. ... View more

@zzeng Great article.  Reach out to me on internal channels.  I would love to show you my oracle to kudu demo, using kafka and schema registry. ... View more

@SandyClouds  ^^ that is how you do it.   One important thing to mention.  That processor is not meant to be deployed in a set it up and forget it situation.   CDC against another database requires a lot more technical attention to how the data is changing over time AFTER you grab data for first time.   In my opinion, this processor is meant to be a conversation starter, or a way to take a 1 time shot of data source, where you may be watching it run, but not expecting it to run indefinitely and keep 2 systems synced. ... View more

@ushasri You should check out NiFI Registry:   https://nifi.apache.org/registry.html   Using NiFi Registry you are able to version control flows during development.  Using same Nifi Registry you can now deploy these flows to other environment(s) such as your Cloudera licensed version (HDF,CDF,CFM).      Additionally, XML templates are going away.  In modern versions of nifi, you should use the Create Flow Definition, and transfer these JSON definition files manually between environments and/or nifi developers.       Other CI/CD DFLC (Data Flow Lifecycle) concepts for deploying flows across environments are using NIFI CLI API programmatically to do manual deployment operations.  We also often seen some level of integration between Github and NiFi Registry. ... View more

Can't wait for this event!  Let's go!! ... View more

@FediMannoubi Get the required response data that you need from flowfile to an attribute with EvaluateJsonPath.  Do this for user, password, and token.     Once these  data values are attributes,  you can use them in the header, or write them back out to the flowfile content when appropriate. ... View more

@bennour This error is an issue with your database endpoint ssl.   My first suggestion is to use the following arugment in your sqoop command:   useSSL=false   then if this doesn't work, focus on getting a proper ssl certificate for the host.     ... View more