Cloudera Community
mbraunerde
user rank
Contributor
My Accepted Solutions
Show All

Re: NiFi RestApi and AzureAD Login

by Contributor in Support Questions
β€Ž07-11-2023 02:07 AM
β€Ž07-11-2023 02:07 AM
Hi guys,   i've got time to check this behaviour! πŸ€—   Here my changes, which i only made and the AzureAD was requested. nifi@ad62a85cc576:/opt/nifi/nifi-current/conf$ diff nifi.properties nifi.properties.fresh 199c199 < nifi.security.user.oidc.discovery.url=https://login.microsoftonline.com/DirecotoryID/v2.0/.well-known/openid-configuration --- > nifi.security.user.oidc.discovery.url= 202,203c202,203 < nifi.security.user.oidc.client.id=ApplicationID < nifi.security.user.oidc.client.secret=ClientSecret --- > nifi.security.user.oidc.client.id= > nifi.security.user.oidc.client.secret= 205,207c205,207 < nifi.security.user.oidc.additional.scopes=profile < nifi.security.user.oidc.claim.identifying.user=email < nifi.security.user.oidc.fallback.claims.identifying.user=upn --- > nifi.security.user.oidc.additional.scopes=offline_access > nifi.security.user.oidc.claim.identifying.user= > nifi.security.user.oidc.fallback.claims.identifying.user= That was only my first try. I will keep everyone up to date, if i got more infos ... View more

Re: NiFi RestApi and AzureAD Login

by Contributor in Support Questions
β€Ž05-27-2023 02:49 AM
β€Ž05-27-2023 02:49 AM
Hi,   thx for your hints. AzureAD Login is already working, but I will check why after my vacations and keep this topic updated. ... View more

Re: NiFi RestApi and AzureAD Login

by Contributor in Support Questions
β€Ž05-23-2023 11:08 PM
β€Ž05-23-2023 11:08 PM
If nobody got a solution, that's okay, but does anybody got a hint for me to solve the authentication at the rest api of nifi regarding AzureAD OAuth2?   *edited - fix typo* ... View more

NiFi RestApi and AzureAD Login

by Contributor in Support Questions
β€Ž05-19-2023 04:45 AM
β€Ž05-19-2023 04:45 AM
Hi guys,   i'm working on a NiFi 1.21.0 and the user login is connected to AzureAd. It's working a nice way for all humans, but we want to check the nifi with our monitoring solution.   My login-identity-providers.xml contains     <loginIdentityProviders> <provider> <identifier>single-user-provider</identifier> <class>org.apache.nifi.authentication.single.user.SingleUserLoginIdentityProvider</class> <property name="Username">known-user</property> <property name="Password">hashed-known-password</property> </provider> </loginIdentityProviders>       My authorizers.xml contains     <authorizers> <userGroupProvider> <identifier>file-user-group-provider</identifier> <class>org.apache.nifi.authorization.FileUserGroupProvider</class> <property name="Users File">./conf/users.xml</property> <property name="Legacy Authorized Users File"></property> <property name="Initial User Identity 1"></property> </userGroupProvider> <userGroupProvider> <identifier>aad-user-group-provider</identifier> <class>org.apache.nifi.authorization.azure.AzureGraphUserGroupProvider</class> <property name="Refresh Delay">5 mins</property> <property name="Authority Endpoint">https://login.microsoftonline.com</property> <property name="Directory ID">DirectoryID</property> <property name="Application ID">ApplicationID</property> <property name="Client Secret">ClientSecret</property> <property name="Group Filter Prefix">Nifi-AAD</property> <property name="Page Size">100</property> </userGroupProvider> <userGroupProvider> <identifier>composite-configurable-user-group-provider</identifier> <class>org.apache.nifi.authorization.CompositeConfigurableUserGroupProvider</class> <property name="Configurable User Group Provider">file-user-group-provider</property> <property name="User Group Provider 1">aad-user-group-provider</property> </userGroupProvider> <accessPolicyProvider> <identifier>file-access-policy-provider</identifier> <class>org.apache.nifi.authorization.FileAccessPolicyProvider</class> <property name="User Group Provider">composite-configurable-user-group-provider</property> <property name="Authorizations File">./conf/authorizations.xml</property> <property name="Initial Admin Identity">admin@login-domain.com</property> <property name="Legacy Authorized Users File"></property> <property name="Node Identity 1"></property> </accessPolicyProvider> <authorizer> <identifier>managed-authorizer</identifier> <class>org.apache.nifi.authorization.StandardManagedAuthorizer</class> <property name="Access Policy Provider">file-access-policy-provider</property> </authorizer> <authorizer> <identifier>single-user-authorizer</identifier> <class>org.apache.nifi.authorization.single.user.SingleUserAuthorizer</class> </authorizer> </authorizers>       The nifi.properties contains     nifi.authorizer.configuration.file=./conf/authorizers.xml nifi.security.user.authorizer=single-user-authorizer nifi.security.allow.anonymous.authentication=false nifi.security.user.saml.authentication.expiration=12 hours nifi.security.user.authorizer=single-user-authorizer nifi.security.user.login.identity.provider=single-user-provider nifi.security.user.jws.key.rotation.period=PT1H nifi.security.user.oidc.discovery.url=https://login.microsoftonline.com/DirecotoryID/v2.0/.well-known/openid-configuration nifi.security.user.oidc.connect.timeout=5 secs nifi.security.user.oidc.read.timeout=5 secs nifi.security.user.oidc.client.id=ApplicationID nifi.security.user.oidc.client.secret=ClientSecret nifi.security.user.oidc.preferred.jwsalgorithm= nifi.security.user.oidc.additional.scopes=profile nifi.security.user.oidc.claim.identifying.user=email nifi.security.user.oidc.fallback.claims.identifying.user=upn       My Questions: 1) Is it possible to login with the "known user" of login-identity-providers.xml? 2) How can I access the api?   Thank you for your time! ... View more
Labels:

Re: NiFi SFTP Input missing

by Contributor in Support Questions
β€Ž08-02-2022 07:03 AM
1 Kudo
β€Ž08-02-2022 07:03 AM
1 Kudo
I've created a simple processor on my own => https://github.com/mbraunerDE/nifi-plugins/blob/4cd76e047af88e2ec84f51c883b40f74d1bb9ef0/nifi-mbrauner-plugins-processors/src/main/java/de/mbrauner/nifiplugins/processors/ListSFTPWithInput.java ... View more

Re: Merge Queue Attributs, but not the content

by Contributor in Support Questions
β€Ž07-10-2022 11:55 PM
β€Ž07-10-2022 11:55 PM
Hi @SAMSAL ,   thank you for your help, but you're absoluty right in your second post - the first one seems very "uncomfortable".   @MattWho: I really don't care about the content, i've created backup-files in the stages before mailing and only the consumed filenames are relevant for mail. Last time there was 350 files and 35MB for backup πŸ˜‰ ... View more

Merge Queue Attributs, but not the content

by Contributor in Support Questions
β€Ž07-08-2022 06:19 AM
β€Ž07-08-2022 06:19 AM
Hi guys,   i've got a queue containing ~1000 files and i want to receive a mail with all ~1000 filenames. I don't care about the content of all files, only the ${filename} should be put on a list and send as content.   Example:   - Queue Position 1 - filename: first.xml - Queue Position 2 - filename: second.xml - Queue Position 3 - filename: third.xml   Resulting mail content (possibility 1): - first.xml - second.xml - third.xml Resulting mail content (possibility 2): first.xml, second.xml, third.xml Something just like a list of filenames in queue. Dies anybody got an idea how to solve without many api-magic? Greetings and best regards - Max ... View more
Labels:

Re: NiFi SFTP Input missing

by Contributor in Support Questions
β€Ž04-06-2022 06:14 AM
β€Ž04-06-2022 06:14 AM
Hey steven-matison, Thank you for the reply, but I think that way is more complicated to get it supported over multiple versions and easy to understand for my next-year-me. ... View more

Re: NiFi SFTP Input missing

by Contributor in Support Questions
β€Ž04-05-2022 11:59 AM
β€Ž04-05-2022 11:59 AM
Hey @steven-matison ,   thanks for replying, but that’s my problem - getsftp provides files and listsftp the data to get it, but listsftp doesn’t allow incoming connections to provide the option per server based on a sql query.   listsftp doc says   Input requirement: This component does not allow an incoming relationship.   and that’s the point - I need a way to provide filename to fetch or ip to connect πŸ€·πŸΌβ€:male_sign: ... View more

NiFi SFTP Input missing

by Contributor in Support Questions
β€Ž04-05-2022 01:36 AM
β€Ž04-05-2022 01:36 AM
Hey guys,   i've been a quite reader in this forums last months and you all provide me a lot of hints and solutions for multiple questions.   Now i've search the documentation and this community, but i'm the first one with this problem i think.   We store all our remote-server ips in a database, the login is the same for all. We want to fetch files (names changes possible) from remote servers and download them. The only (built in) sftp processor with input connection is "GetSFTP", but i have to know the filename to perform a download. i cannot guarantee that the filenames will never change, so this is no way to solve my problem ...   I know, i can create an processor on my own with some development, but my first step is to get it work with built-in ones. Does anybody got a good idea how to solve it or have i to create a processor on my own?   Greetings from Dortmund     ... View more
Labels:
Contact Me
Online
Offline
Last Visited
β€Ž12-10-2024 09:07 AM
Community Statistics
Member Since β€Ž04-05-2022 01:29 AM
Last Visited β€Ž12-10-2024 09:07 AM
Posts 10
Kudos received 1