@morti To add to this, this is essentially (if not just very similar) to nifi's Record API where Record processors require a RecordReader/Writer controller service where the schema for the incoming/outgoing files is defined. All these processors can get their schema from some registry, or have it configured hard-coded, or try to infer the schema, or simply rely on the schema that was given to the flowfile earlier in the flow.   I think it's worth looking into Records in nifi, they're designed specifically for well-defined data and use-cases similar to what your described  ... View more

@raniaa Ambari is no longer part of the Cloudera ecosystem of tools/products.  I would recommend you look for community support for ambari on stackoverflow or the ASF Slack. ... View more

@MattWho    Thank you very much, this worked perfectly for what I was needing.   Can you tell me if this same flow also works with windows? ... View more

@Omarb, Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.  ... View more

Excellent work @carrossoni .  I really see value in the time travel feature!!  ... View more

@clouderonur, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.  ... View more

@Angelvillar I would recommend that you create a SSL Context Service using javas cacerts as the keystore and truststore.   If that doesnt work,  THEN, try to make your own with the certs from the ELK server.   Here is a similar post with a lot more details of how that looks with cacerts and details for alternative custom keystore/trustore.     https://community.cloudera.com/t5/Support-Questions/Configure-StandardSSLContextService-for-Elasticsearch/m-p/302719     ... View more

@Olivia_4692 users usually screen shot, then blur anything you need to hide.   Just capture the property/value settings modal, not entire screen of your computer.    Not being able to see what you see, i will continue to make some suggestions.    Since you are using Kerberos, the doc page i referenced has this property:   Property DescriptionAuthenticationMethod {kerberos or userIdPassword}. Determines which authentication method the driver uses when establishing a connection. If set to kerberos, the driver uses Kerberos authentication. The driver ignores any user ID or password specified. If you set this value, you also must set the ServicePrincipalName property. If set to userIdPassword (the default), the driver uses user ID/password authentication. If a user ID and password is not specified, the driver throws an exception. The User property provides the user ID. The Password property provides the password. See Authentication for more information about using authentication with the Sybase driver. The default is userIdPassword.   based on this i believe you should have AuthenticationMethod=kerberos in your jdbc url.     There are further details for How to Configure Kerberos, please be sure to follow them all:   https://docs.oracle.com/cd/E12839_01/web.1111/e13753/sybase.htm#JDBCD390     ... View more