Q&A

Hello everyone,I have installed Apache NiFi 2.7.1 on RHEL9. Unfortunately, I can't access it via a web browser (port 8443) from another computer.The firewall in RHEL is configured for port 8443, and even disabling the firewall doesn't allow access.The following entries appear in the nifi-app-log:2025-12-17 13:27:51,876 INFO [main] org.eclipse.jetty.server.Server Started oejs.Server@6f25bf88{STARTING}[12.1.5,sto=0] @11898ms2025-12-17 13:27:51,877 INFO [main] org.apache.nifi.web.server.JettyServer Started Server on https://vm-P004-4067:8443/nifi 2025-12-17 13:27:51,883 INFO [main] o.a.n.runtime.StandardManagementServer Started Management Server on http://127.0.0.1:52020 2025-12-17 13:27:51,884 INFO [main] org.apache.nifi.runtime.Application Started Application in 15.213 seconds (15213111810 ns)In the nifi.properties file, I only specified the hostname of the Linux server in the following entry: nifi.web.https.host.Does anything else need to be configured? All the example videos

My company does not allow Java any more. Does the Impala JDBC driver work with alternatives, such as Zing?Thanks,Kevin

Hi All, I am able to launch the Oozie work flow using Oozie Webservice API  via CURL utility .Like about perform HTTP GET and POST requests . Example curl command:curl -u guestuser:guestpwd  -X POST -H "Content-Type: application/xml;charset=UTF-8" -d @Former Member.xml "https://knowxhost:8443/gateway/cdp-proxy-api/oozie/v1/jobs?action=start" url: https://knowxhost:8443/gateway/cdp-proxy-api/oozie/v1/job/0000009-210910123241282-oozie-oozi-W'Also in python , I can fetch the Oozie executed workflow.    response = requests.get(url, auth=HTTPBasicAuth('guestuser','guestpwd '), verify=False).text     But unable to perform the POST request and getting 500 Error . url = 'https://knowxhost:8443/gateway/cdp-proxy-api/oozie/v1/jobs?action=start'    response = requests.post(url, auth=HTTPBasicAuth('guestuser','guestpwd'), verify=False, data=xml, headers=headers).text    Exception

Please find the below screenshot and attached logs. Error:SEVERE: The Integration Service failed to run the Hive task [Write_test_1jiq2sdd]. See the additional error messages for more information.com.informatica.sdk.dtm.ExecutionException: [[HIVE_1070] The Integration Service failed to run Hive query [Write_test_1jiq2sdd_query_3] for task [Write_test_1jiq2sdd] due to following error: Hive error code [2], Hive message [Error while compiling statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1764063775281_0054_1_00, diagnostics=[Vertex vertex_1764063775281_0054_1_00 [Map 1] killed/failed due to:INIT_FAILURE, Fail to create InputInitializerManager, java.util.concurrent.ExecutionException: org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator  2025-11-26 14:25:24,278 AST <LdtmWorkflowT

Hello!NiFi version - 2.5.0Java - 21When trying to run ExecuteSQL processor i'm getting error:What does it mean and where is this unsupported field located? Log:It's something wrong with java or nifi or whole system?Please, help me to figure it out 

Intel's 2003 patent: Method and apparatus for parallel table lookup using SIMD instructionshttps://patents.google.com/patent/US20040054879A1/enIn July 2006, Intel noted that PSHUFB was available on the Core 2 Duo CPUs, such as the X6800, to some companies and universities working with error correction code. I recall some published programs that were using it later on that year (around September 2006). However I've seen one or more later patents (2010 or later) that include using PSHUFB for parallel table lookup, which doesn't make sense. 

I have multiple instances of nifi running and a central nifi registry is deployed. NiFi Registry is signed by an independent self-issued CA-signed certificate.I do have a copy of NiFi Registry's truststore and keystore inside my NiFi instance (Kubernetes Pod). And I have configured the registry client with my registry's internal k8s service URL and the associated SSL Context is referenced to the Registry's truststore and keystores. The SSL Context Controller enables fine (indicating the keystores are accessible and the passwords are correct) but then I get the following error message while trying to enable versioning on a process group:Unable to obtain listing of buckets: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested targetI checked the other topics on this forum and on other forums on the Internet and found that this could be an issue with the validity of the registry's server certificate. Th

Hi,So I have a standard stand alone install of nifi 2.5.0 on windows 10 ( no LDAP etc ) which created a generated username and password, and which allows me to log in fine.What I want to do is change this existing nifi generated user from being a normal user to an administrator. Its so i can create new processors via the api.  Apparently on the very first login to a new nifi instance it logs you in as admin, but I tried this and couldnt see any options on the menu etc that looked like I had admin privs. But when it starts and runs, it uses port 8400, so its possible someone in the company may have modified the set up slightly? When it starts for the first time it goes through the expansion process.Can someone please suggest the steps to change the generated normal user to admin level please, or if maybe I'm going about this the wrong way?  I have consulted the following doco but no joy. https://nifi.apache.org/nifi-docs/administration-guide.html#creating-users-groupsI have sp

 Error importing NiFi workflow template from version 1.x to 2.xI'm having trouble migrating my NiFi workflow from version 1.9.2 to version 2.0 using the export template and import template functions. Any assistance would be greatly appreciated.

Hello,I've installed nifi 2.6 registry security - then I've scanned it in AWS Inspector, it shows me the following results:0 Critical.12 High.12 Medium.Could anyoune confrim the results? And if this is a stable security version?

Hello there, I'm having a problem while trying to start a newly added node's yarn NodeMgr.When I start it via Cloudera Manager console, I've got this in logs:2025-12-09 10:15:52,431 ERROR org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Unexpected error starting NodeStatusUpdaterorg.apache.hadoop.yarn.exceptions.YarnRuntimeException: Received SHUTDOWN signal from Resourcemanager, Registration of NodeManager failed, Message from ResourceManager: Disallowed NodeManager from cloudera06apl.claro.amx, Sending SHUTDOWN signal to the NodeManager.at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:426)at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:272)at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)at org.apache.hadoop.service.AbstractService.start(Abs

Hi Team,We are on CDP 7.1.9 SP1 and on OS version RHEL 7. As RHEL 7 is EOL we are planning to upgrade to RHEL 8 and also mysql 5.7 to 8.  Since it is production environment we are little bit concerned how complex it would be. Our CM services and mysql database of cm and application are residing on the same node.Kindly suggest apart from taking mysqldump backups and exporting the database/table what else we need to take care of post OS upgrade to rhel 8, I mean I am aware of re-installing el8 cm packages but for mysql we have to install from rpms of el8 so finding it little tricky.

Good morning to the community, I would like to raise a problem that I am having with a nifi cluster that I manage version 1.11.4, during the night a nifi node goes down, every day for about a month now, when we were developing some contingency processes it started to fail with the fall of a node, although it is true that I am clear about which processes it is, I need to understand how I can repair the problem from the process front and from the nifi front, attached is the nifi app_user.log log and the zookeeper log, to see if you can help me.log user_app.loglog zookeeperI look forward to any support. Greetings to all.

Hello community, greetings again. I'm currently analyzing how to migrate from NIFI 1.11.4 to 2.0. My strategy is to create and export my workflow template to version 1.9.2, which worked correctly. Now, from there, I want to migrate to version 2.0. Using the same method, all of this done locally on Windows, to later install the final version of the NiFi cluster from a Docker image, the problem I encountered is that version 2.0 of NiFi requires a username and password. Upon reviewing comments and documentation on the matter, I see that they indicate extracting the user from the nifi-app.log file, searching for "0" in the "Generated Username" file, but that doesn't appear in my log file, and I also can't find the Windows command to generate the user; I only see it for Linux. My question is, is there any method to generate users in Windows, or is there any... HOW TO DEFINE IT IN THE login-identity-providers.xml FILE?

Hello,We have a 3 nodes cluster. We migrate our system from Nifi 1.23.2 to Nifi 2.4 with a stop at Nifi 1.28.1 as recommended in migration docs.Our flows were working as expected for the part 1.23.2 -> 1.28.1. We prepared the migration to Nifi 2 as explain in docs (remove variables and deprecated processors, modified CRON to remove the 7th digit...). Tests were OK.We then upgrade from 1.28.2 to Nifi 2.4. Just after this upgrade, our flows containing queues with round robin strategy getting stucked.One example, we ingest a XML file in the primary node (let's call it node0), do some stuffs, no problem. We then split the file by lines and send each lines to an EvaluateXPath to analyse the data. This queue between the SplitXML and EvaluateXPath has a round robin strategy to improve perfs. Just after the upgrade from 1.28.1 to Nifi 2.4 only one third of the lines were processed the lines that should be sent to the node1 et node2 are not processed and stay in the queue. Only reccords

When I try to run a query against the nifi 2.5.0 API to get info about provenance activities, it seems to be quite difficult.I installed NIfi on my PC with no modifications and all default settings, and just use the default user and password that's created when you install it.I run this in my local windows CMD window and get   "unknown error" :curl --insecure -X DELETE -H "Authorization: Bearer <my token> " https://localhost:8443/nifi-api/provenance/queriesThen I run this and get : curl --insecure -X DELETE -H "Authorization: Bearer <token>" https://localhost:8443/nifi-api/provenance/queries > test.txtIn text.txt file I get :"An unexpected error has occurred. Please check the logs for additional details."I'm starting to think the Provenance part of the API might be broken as it shouldn't be this hard?I ran other API queries and they work fine.What I'm trying to do is get a list of all files that have passed through my small local nifi installation so we ca

We need to set up OIDC authentication in Apache NiFi. However, our OIDC provider is only reachable through an HTTP/HTTPS proxy. How can we configure NiFi to use this proxy when performing OIDC authentication? Are there specific properties that must be added to nifi.properties or any additional configuration required so that NiFi accesses the OIDC provider through the proxy?Thank you for your response 

 Hello,For a project, I need to configure a WebSocket connection using NiFi. I also need to define a custom sub-protocol in the “Sec-WebSocket-Protocol” header.I have seen that some custom headers can be defined in the parent FF with the “header.Something” attribute. In fact, all headers are defined except for the sub-protocol. How can I achieve this without having to develop my own processor?My GenerateFlowFile has the following attributes: `header.Sec-WebSocket-Protocol = Test` and another `header.Test = Test2`.The request retrieved by Wireshark only uses header.Test. Is it normal ?Thanks.(related to https://community.cloudera.com/t5/Support-Questions/Nifi-websocket-subprotocols/m-p/311764#M224816 and https://community.cloudera.com/t5/Support-Questions/NiFi-WebSocket-Headers/m-p/361488)

When trying to login via sso I receive this error message.  403There was a problem authenticating your request.Cloudera SSO is disabled for Account '14f772e1-c5b2-48f5-b354-993f95d0da10'. To log in, use your identity provider. To re-enable Cloudera SSO Login, speak with your CDP administrator.Request ID: db73097d-1e99-4b98-a342-feff906ba5aa

I need to pull data from pager duty that needs a date in the url.  This is an example:https://api.pagerduty.com/oncalls?include%5B%5D=users&schedule_ids%5B%5D=AAAAAA&schedule_ids%5B%5D=BBBBBB&schedule_ids%5B%5D=CCCCCC&schedule_ids%5B%5D=DDDDDD&since=2025-12-04&until=2025-12-05&earliest=trueThe two parameters are since and until.  The intent is this runs once a day and a new date value set for each day.  Something tells me it may look like this:https://api.pagerduty.com/oncalls?include%5B%5D=users&schedule_ids%5B%5D=AAAAAA&schedule_ids%5B%5D=BBBBBB&schedule_ids%5B%5D=CCCCCC&schedule_ids%5B%5D=DDDDDD&since=#{since_date}&until=#{until_date}&earliest=true but the how I don't know.  I'll continue searching, but if anyone has a solution I will be thankful.

Dear TeamI am currently pursuing the CLOUDERA AI Technical Professional Accreditation (CAITP) certification. I have completed the first two courses successfully; however, I am unable to move forward to the third course because there is no “Launch” button available.Additionally, although the first two courses show as completed individually, the overall certification progress is not updated and does not reflect the completion percentage. Due to this issue, the certification appears to be blocked, and I am unable to continue with the remaining courses.For comparison, I have already completed the CLOUDERA AI Sales Professional Accreditation (CAISP) certification without encountering any issues.Could you please assist me in resolving this problem and enable access to the remaining CAITP courses?Thank you, and I look forward to your support.

Dears,my cluster is TLS and Kerberized, and when try to add CFM 2.1.7 ( NIFI ).i used https://docs-archive.cloudera.com/cfm/2.1.1/cfm-security/topics/cfm-security-ldap-authentication.htmlto configure LDAP however, i go the below error from NIFI WebUI "Authentication Proxy Server not trusted"Any idea how to solve this.

Hello,In Cloudera Data Flow, how should an InvokeHTTP processor be configured to be able to invoke the underlying nifi's rest api? I've tried several (localhost, with and without ssl etc.) options, but the connection is always refused.Thanks,Peter

I have nifi cluster hosted on AKS , its 3 node  with memory 20G each node. node has dedicated pvcs standard lrs.We are seeing occasionally once in 1/2 weeks nifi node-0 only disconnects  with below error.We are running full load ingestions frequently. but there is no pattern . we  run 3-4 processor groups  have overlapping time (parallel).  but not all the time we get error . most of the runs on most of the day work . sometime we get below mentioned error.   what we observed . node-0 first gets disconnected later when it tried to reconnect  org.apache.nifi.controller.serialization.FlowSynchronizationException.Any help possible ? Error dump : 2025-11-01 06:05:19,513 WARN [Notify Cluster of Node Status Change-2] o.a.n.c.p.i.StandardClusterCoordinationProtocolSender Failed to send Node Status Change message to nifi-0.nifi-headless.nifi-highresource-lts.svc.cluster.local:8443org.apache.nifi.cluster.protocol.ProtocolException: Failed to

Hi Team,I have a usecase of JVM application(Java) to be build and deployed on CML.  In  Cloudera data platform,  I see option of DE, Data warehouse, Cloudera AI, Data catalog,  etc. Even after exploring all the option, I could not figure out a straight forward way for the same. Please guide.