About saikrishna_tara

saikrishna_tara · ‎08-29-2017

Yes true , But connecting to Hive from Azure and reporting on top of it is very slow in our case. that's the reason why we are planning to test reporting on top of files.

saikrishna_tara · ‎08-29-2017

Hi,Can we sign-in and upload files to OneDrive using their API.?? Our use case is to send output from HIVE queries daily to our users , and they will use it in their reporting solutions. Some of their reporting solutions (ex PowerBI) run in Azure so it would be easy for them to consume files from One Drive. https://msdn.microsoft.com/en-us/library/office/dn659726.aspx Regards, Sai

saikrishna_tara · ‎08-28-2017

Hi,I am trying to configure LDAP authentication to our NiFi instance, I am using SIMPLE authentication strategy , with the below settings. <provider> <identifier>ldap-provider</identifier> <class>org.apache.nifi.ldap.LdapProvider</class> <property name="Authentication Strategy">SIMPLE</property> <property name="Manager DN">CN=admintarapare,OU=Admins,OU=Users and Groups,OU=GC AMS,OU=AMS,OU=Organizations,DC=mycompany,DC=com></property> <property name="Manager Password">mypwd></property> <property name="TLS - Keystore"></property> <property name="TLS - Keystore Password"></property> <property name="TLS - Keystore Type"></property> <property name="TLS - Truststore"></property> <property name="TLS - Truststore Password"></property> <property name="TLS - Truststore Type"></property> <property name="TLS - Client Auth"></property> <property name="TLS - Protocol"></property> <property name="TLS - Shutdown Gracefully"> </property> <property name="Referral Strategy">FOLLOW</property> <property name="Connect Timeout">10 secs</property> <property name="Read Timeout">10 secs</property> <property name="Url">ldap://ourserver:389</property> <property name="User Search Base">OU=Admins,OU=Users and Groups,OU=GC AMS,OU=AMS,OU=Organizations,DC=mycompany,DC=com></property> <property name="User Search Filter">sAMAccountName={0}</property> <property name="Identity Strategy">USE_DN</property> <property name="Authentication Expiration">12 hours</property> </provider> i am not getting any exception in the nifi-app.log, but getting this in nifi-user.log o.a.n.w.a.c.IllegalArgumentExceptionMapper java.lang.IllegalArgumentException: The supplied username and password are not valid.. Returning Bad Request response. I am using this user admintarapare(which i used in my Manager CN) to login and i know the pwd is correct and i used LDP on my server to verify its connecting to the LDAP server. Any idea on what i am doing wrong here.? Regards, Sai

saikrishna_tara · ‎08-25-2017

Hi @Wynner, i am running on 1.1 and i fixed these 2 issues.. fixed the Kerberos error by using only one Kerberos principal across many connections, earlier i used some connections as NiFi and some as my id..i think it was getting confused some where and throwing errors..once i changed all to use nifi id it is working fine. Only way i could clear hung processes are changing a setting in Ambari to not to pick the files when nifi restarts and restarting NiFi. i couldn't find anyother way.. Regards, Sai

saikrishna_tara · ‎08-22-2017

@Wynner , nevermind , i had a typo..your earlier answer worked !!!! Thanks.

saikrishna_tara · ‎08-22-2017

@Wynner , it still not picking those files..

saikrishna_tara · ‎08-22-2017

Hi, I want to list files that only starts with a word for ex GroupM_Eclipse , and i used this Regex ^GroupM_Eclipse in the ListSFTP file file filter ..but its not picking up any files..any idea why.?? when i dont use any filter , it lists all the files. GroupM_Eclipse_BDM_20170822.csv.gz ,GroupM_Eclipse_BDM_20170821.csv.gz etc.. Regards, Sai

saikrishna_tara · ‎08-15-2017

@Andy LoPresto I am not an expert with SSL and certificates. where can i get more help on this.? Regards, Sai

saikrishna_tara · ‎08-15-2017

Hi , I am in the process of setting up my windows NiFi instance to use LDAP Authentication . I am getting the error below when i type in my userid and pwd. i am also copying my ldap-identity-providers.xml login-identity-providers.xml, app.log ,user log and authorizers.xml authorizers.xml i followed this url https://community.hortonworks.com/articles/17293/how-to-create-user-generated-keys-for-securing-nif.html to create keystore,truststore. i didn't create any client certificates as i am planning to use LDAP. ---Error from App log 017-08-15 12:02:50,322 INFO [NiFi Web Server-39] c.s.j.s.i.application.WebApplicationImpl Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM' 2017-08-15 12:03:08,040 ERROR [NiFi Web Server-33] org.apache.nifi.ldap.LdapProvider Failed to negotiate TLS session; nested exception is javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target 2017-08-15 12:03:21,908 ERROR [NiFi Web Server-53] org.apache.nifi.ldap.LdapProvider Failed to negotiate TLS session; nested exception is javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested targetested target 2017-08-15 12:03:21,908 ERROR [NiFi Web Server-53] org.apache.nifi.ldap.LdapProvider Failed to negotiate TLS session; nested exception is javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target 2017-08-15 12:03:26,884 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@63b85d97 checkpointed with 1 Records and 0 Swap Files in 72 milliseconds (Stop-the-world time = 15 milliseconds, Clear Edit Logs time = 47 millis), max Transaction ID 2 2017-08-15 12:03:29,257 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository 2017-08-15 12:03:30,244 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@61868687 checkpointed with 0 Records and 0 Swap Files in 978 milliseconds (Stop-the-world time = 224 milliseconds, Clear Edit Logs time = 738 millis), max Transaction ID -1 User log is attached.nifi-user.txt Regards, Sai

saikrishna_tara · ‎08-08-2017

Yes, ( right-click , download or clear ) is what i am doing currently. But we cannot have this manual dependency in production env right.? thats why i was checking to see if there is any better way. We are planning to migrate to HDF 3.0 soon , hopefully it works.

Online	Offline
Last Visited	‎10-26-2018 04:07 PM

Member Since	‎07-08-2016 07:25 PM
Last Visited	‎10-26-2018 04:07 PM
Posts	260
Kudos received	44

Cloudera Community

Re: I am using unpack processor in NIFI to unzip a...

Re: Changing NiFi Templates

Re: Hive Connection Pool Kerberos Issue

Re: NiFi user getting Tez exception

Re: Help with Hive Regex extract.

Re: Can we upload files to OneDrive using NiFi.?

Can we upload files to OneDrive using NiFi.?

LDAP Authentication Issue

Re: Hive Connection Pool Kerberos Issue

Re: NiFi ListSFTP File Filter RegEx Not Listing fi...

Re: NiFi ListSFTP File Filter RegEx Not Listing fi...

NiFi ListSFTP File Filter RegEx Not Listing files

Re: NiFi LDAP Authentication Error

NiFi LDAP Authentication Error

Re: NiFi ConvertJSONToAvro is not routing errors t...