Member since
10-17-2022
12
Posts
2
Kudos Received
0
Solutions
02-12-2024
12:30 AM
1 Kudo
Hi, Can anyone please update this query?
... View more
02-07-2024
12:25 AM
Hi, I have gone through multiple community support link, where it is mainly saying to start cluster, say, 50MB/s And 1000 events/sec sustained throughput for average Flow is: 3 nodes each with: CPU: 8+ cores (16 is preferred) Memory: 8+ GB Disk: 6 disks, each 1TB disks (could be spinning or SSD) Referred link: https://community.cloudera.com/t5/Community-Articles/NiFi-Sizing-Guide-Deployment-Best-Practices/ta-p/246781 My Nifi (version 1.23.2) cluster maintaining below hardware configuration, where Disk is a concern in my environment. Only one disk and all the repository is using the same default Nifi configuration. What will be expected throughput in these case ? 3 nodes each with: CPU: 8+ cores (16 is preferred) Memory: 8+ GB Disk: 1 disk of 500GB (could be spinning or SSD) 5 nodes each with: CPU: 8+ cores (16 is preferred) Memory: 8+ GB Disk: 1 disk of 500GB (could be spinning or SSD) 7 nodes each with: CPU: 8+ cores (16 is preferred) Memory: 8+ GB Disk: 1 disk of 500GB (could be spinning or SSD)
... View more
Labels:
- Labels:
-
Apache NiFi
01-31-2024
10:58 PM
1 Kudo
Hi Team, I am using Nifi (3-node cluster) version 1.23.2 in my environment. My doubt, is there any case if Nifi processor (any processor within a process group) stops suddenly due to load/any other issue? If that happens, then what will be the solution? Does it lead to data loss?
... View more
Labels:
- Labels:
-
Apache NiFi
01-28-2024
10:36 PM
Hi, I am using 3 node NiFi (Version: 1.23.2) cluster. If a node goes down, it is known that the flow can be directed to another node, but what about the data that is queued in the failed node? Is there anyway to replicate the data from failed node to other node? or will have to wait until the node comes back up? Please explain how to handle this scenario.
... View more
Labels:
- Labels:
-
Apache NiFi
01-02-2024
11:42 PM
Thanks for your reply @ckumar ! I am using GCP services to create LB. for the backend services of LB we used session affinity as "client IP" ( As shown below in the Screen Shot). Adding to this I used curl command to generate the token using LB URL, which is responding correctly. But Nifi UI still have the error. URL used : curl --location --request POST 'http://<LoadBalancer>/nifi-api/access/token' --header 'Content-Type: application/x-www-form-urlencoded' --data-urlencode 'username=<MyUser>' --data-urlencode 'password=<MyPassword>' Further, for debugging the root cause, I added only one Nifi server on the LB Backend, still getting the same error.
... View more
12-28-2023
09:24 PM
Its not on the container. and I am trying to login using username and password
... View more
12-28-2023
03:31 AM
Hi, I have 3-node Nifi cluster using self signed certificate. and that is working fine. Now I want to run these 3 node Nifi UI (port 8443) behind Load Balancer. The changes I have in nifi.properties file is: nifi.web.proxy.host=localhost:8443,nifiinstance-group-1:8443,<load-balancer> All Nifi UI has same credential. and loadBalancer is using HTTP connection. Now, Nifi UI is coming up, but while passing the credentials it is throwing error: there is no such error in nifi logs: 3X.XX.XX.XX - - [28/Dec/2023:11:03:12 +0000] "GET /nifi/ HTTP/1.1" 200 21126 "http://3X.XX.XX.XX/nifi/login" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36" Please guide me with the root cause if this problem and how to solve this?
... View more
Labels:
- Labels:
-
Apache NiFi
10-06-2023
03:49 AM
Thank you For your response @MattWho . Please help me with these basic information: 1. I can get three separate Keystores (one for each NiFi node), from Nifi-toolkit 2. I also have Keystore and truststore shared by IT Team(which is signed certificate), where cn=*.domainlabs.com Now, Should I merge these two keystore and truststore? If yes, please share steps to merge that.
... View more
10-05-2023
01:32 AM
Hi Team, I already created 3 node Nifi secured cluster with self signed certificated , where I used nifi-toolkit to do the task. But now I have signed certificate (shared by IT team), the pem and key file. Can you please help (step by step guide) to create 3 node nifi cluster using that certificate?
... View more
Labels:
- Labels:
-
Apache NiFi
11-16-2022
09:40 PM
Hi Team, We are Using Apache Nifi to Publish events to PubsubLite using (PublishGCPubSubLite 1.17.0) Nifi processor. GCP SA json files contains below field: { "type": "service_account", "project_id": "", "private_key_id": "", "private_key": "", "client_email": "", "client_id": "", "auth_uri": "", "token_uri": "", "auth_provider_x509_cert_url": "", "client_x509_cert_url": "" } We tried using type:"service_account" and it is getting failed to communicate. and we are getting the below error, PublishGCPubSubLite[id=7f9baf80-0184-1000-ffff-ffff8ec321b3] Failed to create Google Cloud PubsubLite Publisher: com.google.api.gax.rpc.UnauthenticatedException: io.grpc.StatusRuntimeException: UNAUTHENTICATED: Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project. - Caused by: io.grpc.StatusRuntimeException: UNAUTHENTICATED: Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project. From Nifi server we tested the connectivity and credential, it is working: ./google-cloud-sdk/bin/gcloud auth login --cred-file gcp.json Authenticated with service account credentials for: [****@****.iam.gserviceaccount.com]. Your current project is [None]. You can change this setting by running: $ gcloud config set project PROJECT_ID Please suggest how to make connection to PubsubLite on Apache Nifi
... View more
Labels:
- Labels:
-
Apache NiFi