Solved

I am new to nifi trying to install it but when I run command nifi.cmd start I get this:JAVA_HOME=C:\Program Files\Java\jdk-21NIFI_HOME=C:\nifi-2.7.2-bin\nifi-2.7.2but it doesn't write that "nifi has started" when I checked the log file it has the following:nar\extensions\nifi-server-nar-2.7.2.nar-unpacked\NAR-INF\bundled-dependencies\nifi-ui-2.7.2.war] Context Path [/nifi]2026-01-17 19:26:53,803 INFO [main] org.apache.nifi.web.server.JettyServer Loading WAR [C:\nifi-2.7.2-bin\nifi-2.7.2\.\work\nar\extensions\nifi-server-nar-2.7.2.nar-unpacked\NAR-INF\bundled-dependencies\nifi-web-api-2.7.2.war] Context Path [/nifi-api]2026-01-17 19:26:53,810 INFO [main] org.apache.nifi.web.server.JettyServer Loading Docs [C:\nifi-2.7.2-bin\nifi-2.7.2\docs] Context Path [/nifi-api]2026-01-17 19:26:53,813 ERROR [main] org.apache.nifi.runtime.Application Start Server failedjava.lang.IllegalStateException: Management Server Address System Property [org.apache.nifi.management.server.address] not valid [127.

Hello team & community 🙂I am looking into deploying many instances of a flow that is versioned in a git registry via the REST API. My current issue is that I would like to configure each instance of this flow dynamically, though if I version the flow with a Parameter Context attached to it, whenever I deploy instances of it they all end up attaching to a single Parameter Context. I understand this is the expected behaviour as described in the documentation. Therefore, I'd like to know if there is any recommended practice for situations such as mine. The best solution I could think of was perhaps configuring the processors in the flow to use parameters but not to actually attach a PC to the process group. This way I could deploy flows in two steps by first importing them and then creating a new parameter context & configuring/attaching it. I would greatly appreciate any advice for this use-case,Thank you.

Hi all,I've run into an interesting issue where corrupted entries with rowkeys containing a single comma (,) were inserted into hbase:meta. These rows show up in scans, but get, delete, and deleteall operations don't work on them. Example of such a row:ROW COLUMN+CELLrowkey, column=info:regioninfo, timestamp=..., value=...Attempts to remove them with the Java client and HBCK2 (fixMeta) didn't work.Has anyone dealt with this before? Is there a safe way to remove or repair such dangling/corrupted rowkeys from hbase:meta?In addition, I have opened this upstream issue reporting the problem: https://issues.apache.org/jira/browse/HBASE-29554Thanks in advance for any guidance.

Hi everyone, I’m encountering a critical issue with HBase 2.x: the RegionServer fails to connect to the Master, throwing a “GSS initiate failed” error. Environment:Master node: host117RegionServer node: host121Kerberos security is enabled To troubleshoot this, I’ve performed the following checks and fixes—all verified as successful (:white_heavy_check_mark:): Time SynchronizationClock skew across cluster nodes is only 8 seconds, well within Kerberos tolerance (typically ≤ 5 minutes).Hostname ResolutionAdded explicit entries in /etc/hosts for both host117 and host121 to ensure bidirectional hostname resolution, eliminating potential Kerberos failures due to DNS issues.Network ConnectivityConfirmed TCP connectivity to the Master’s RPC port using telnet host117 16000.Kerberos Client Configuration (/etc/krb5.conf)Verified KDC is reachable and TGS requests succeed.Confirmed support for AES256 and AES128 encryption types, matching HBase requirements.JAAS Configuration Fix

Hi Folks,I have 2 NameNode (HA), 16 DataNode, and 5 JournalNode. When I tried to shutdown 8 DataNode, 2 NameNode was down and not running.Please give me a solution for my case. How many journal nodes are needed to be able to handle a minimum of 8 DataNodes that are down or have a greater than 50% failure rate?Pleas Advice.....

Hi all,I'm facing an issue with HDFS 3.3.5 cluster.I have created a total of 650 files with replication set to 1 and block size set to 4MB and each file size is 4MB which should result in a subtotal of 2.5GB, but the storage utilisation is marked closer to 100% due to this.Thanks.

I have a 3 node cluster (ml1, ml2, and vortex). ml1 is the namenode, ml2 and vortex are datanodes. Last week we had a power shutdown in our school and since then i have not been able to access the files in hdfs.When i try to see the "Head of the file" i get an error: "Couldn't find datanode to read file from. Forbidden".The size of the file is correct (my understanding is that the file is still somewhere). The output of command: hdfs dfsadmin -report is as below:Configured Capacity: 2088742875136 (1.90 TB)Present Capacity: 1673267032064 (1.52 TB)DFS Remaining: 942202814464 (877.49 GB)DFS Used: 731064217600 (680.86 GB)DFS Used%: 43.69%Replicated Blocks:Under replicated blocks: 0Blocks with corrupt replicas: 0Missing blocks: 6303Missing blocks (with replication factor 1): 6303Low redundancy blocks with highest priority to recover: 0Pending deletion blocks: 0Erasure Coded Block Groups:Low redundancy block groups: 0Block groups with corrupt internal blocks: 0Missing block groups: 0Low redu

Hi everyone,I'm using Hadoop 3.1.1 and have encountered an issue: after running the DataNode for a few days, it eventually becomes unresponsive. When inspecting the threads of the DataNode process, I found that many of them are stuck in DataXceiver. I'd like to ask if anyone has encountered this before and if there are any recommended solutions.[root@dn-27 ~]# top -H -p 74042top - 17:24:14 up 10 days, 4:05, 1 user, load average: 140.45, 114.30, 110.42Threads: 792 total, 36 running, 756 sleeping, 0 stopped, 0 zombie%Cpu(s): 54.7 us, 38.0 sy, 0.0 ni, 7.2 id, 0.0 wa, 0.0 hi, 0.1 si, 0.0 stKiB Mem : 52732768+total, 22929336 free, 29385958+used, 21053875+buff/cacheKiB Swap: 0 total, 0 free, 0 used. 22594056+avail MemPID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND56353 hdfs 20 0 11.3g 8.0g 34484 R 99.9 1.6 103:13.94 DataXceiver for72973 hdfs 20 0 11.3g 8.0g 34484 R 99.9 1.6 70:57.77 DataXceiver for84061 hdfs 20 0 11.3g 8.0g 34484 R 99.9 1.6 60:03.79 DataXceiver for11326 hdfs 20 0 11.3g

Hi All,   I have a 3 node HDP cluster and on which 2 nodes act as namenode as data node. We have recently extended the disk of HDFS from 1 tb to 3 TB. After that system got reboot and since that my name nodes are comming up.    Name node logs are mentioned below 2022-05-01 14:00:49,272 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(979)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis2022-05-01 14:00:49,274 INFO util.GSet (LightWeightGSet.java:computeCapacity(395)) - Computing capacity for map NameNodeRetryCache2022-05-01 14:00:49,274 INFO util.GSet (LightWeightGSet.java:computeCapacity(396)) - VM type = 64-bit2022-05-01 14:00:49,275 INFO util.GSet (LightWeightGSet.java:computeCapacity(397)) - 0.029999999329447746% max memory 2.0 GB = 621.3 KB2022-05-01 14:00:49,275 INFO util.GSet (LightWeightGSet.java:computeCapacity(402)) - capacity = 2^16 = 65536 entries2022-05-01 14:00:49,299 INFO common.Storage (Storage.java

I have installed and started Nifi.sh, it started and failed in next few seconds.nifi.properties# We recommend configuring HTTPS instead. The administrators guide provides instructions on how to do this.nifi.web.http.host=localhostnifi.web.http.port=8080nifi.web.http.network.interface.default=##############################################nifi.web.https.host=localhost#nifi.web.https.port=8443nifi.web.https.network.interface.default=nifi.web.https.application.protocols=h2 http/1.1nifi.web.jetty.working.directory=./work/jettynifi.web.jetty.threads=200nifi.web.max.header.size=16 KBnifi.web.proxy.context.path=nifi.web.proxy.host=nifi.web.max.content.size=nifi.web.max.requests.per.second=30000  error.log 2025-12-31 14:03:57,387 INFO [main] org.apache.nifi.bootstrap.Command Application Process [9606] started2025-12-31 14:03:57,388 INFO [main] org.apache.nifi.bootstrap.Command Bootstrap Process Running2025-12-31 14:04:57,392 INFO [StartBootstrapCommand] o.a.n.b.c.Application

I have to temporarily change permissions to several files so I'm planning to take a snapshotbefore issuing chmod commandI know that restoring a file from a snapshot is done using cp commandIn this case what does it happen, is it just restored the inode?What does it happen to unmodified files runningcp <snaproot>/.snapshot/<name>/* <target dir>/Are those file skipped?

Hello everyone,I have installed Apache NiFi 2.7.1 on RHEL9. Unfortunately, I can't access it via a web browser (port 8443) from another computer.The firewall in RHEL is configured for port 8443, and even disabling the firewall doesn't allow access.The following entries appear in the nifi-app-log:2025-12-17 13:27:51,876 INFO [main] org.eclipse.jetty.server.Server Started oejs.Server@6f25bf88{STARTING}[12.1.5,sto=0] @11898ms2025-12-17 13:27:51,877 INFO [main] org.apache.nifi.web.server.JettyServer Started Server on https://vm-P004-4067:8443/nifi 2025-12-17 13:27:51,883 INFO [main] o.a.n.runtime.StandardManagementServer Started Management Server on http://127.0.0.1:52020 2025-12-17 13:27:51,884 INFO [main] org.apache.nifi.runtime.Application Started Application in 15.213 seconds (15213111810 ns)In the nifi.properties file, I only specified the hostname of the Linux server in the following entry: nifi.web.https.host.Does anything else need to be configured? All the example videos

My company does not allow Java any more. Does the Impala JDBC driver work with alternatives, such as Zing?Thanks,Kevin

Hi All, I am able to launch the Oozie work flow using Oozie Webservice API  via CURL utility .Like about perform HTTP GET and POST requests . Example curl command:curl -u guestuser:guestpwd  -X POST -H "Content-Type: application/xml;charset=UTF-8" -d @Former Member.xml "https://knowxhost:8443/gateway/cdp-proxy-api/oozie/v1/jobs?action=start" url: https://knowxhost:8443/gateway/cdp-proxy-api/oozie/v1/job/0000009-210910123241282-oozie-oozi-W'Also in python , I can fetch the Oozie executed workflow.    response = requests.get(url, auth=HTTPBasicAuth('guestuser','guestpwd '), verify=False).text     But unable to perform the POST request and getting 500 Error . url = 'https://knowxhost:8443/gateway/cdp-proxy-api/oozie/v1/jobs?action=start'    response = requests.post(url, auth=HTTPBasicAuth('guestuser','guestpwd'), verify=False, data=xml, headers=headers).text    Exception

Hello!NiFi version - 2.5.0Java - 21When trying to run ExecuteSQL processor i'm getting error:What does it mean and where is this unsupported field located? Log:It's something wrong with java or nifi or whole system?Please, help me to figure it out 

I have multiple instances of nifi running and a central nifi registry is deployed. NiFi Registry is signed by an independent self-issued CA-signed certificate.I do have a copy of NiFi Registry's truststore and keystore inside my NiFi instance (Kubernetes Pod). And I have configured the registry client with my registry's internal k8s service URL and the associated SSL Context is referenced to the Registry's truststore and keystores. The SSL Context Controller enables fine (indicating the keystores are accessible and the passwords are correct) but then I get the following error message while trying to enable versioning on a process group:Unable to obtain listing of buckets: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested targetI checked the other topics on this forum and on other forums on the Internet and found that this could be an issue with the validity of the registry's server certificate. Th

Hi,So I have a standard stand alone install of nifi 2.5.0 on windows 10 ( no LDAP etc ) which created a generated username and password, and which allows me to log in fine.What I want to do is change this existing nifi generated user from being a normal user to an administrator. Its so i can create new processors via the api.  Apparently on the very first login to a new nifi instance it logs you in as admin, but I tried this and couldnt see any options on the menu etc that looked like I had admin privs. But when it starts and runs, it uses port 8400, so its possible someone in the company may have modified the set up slightly? When it starts for the first time it goes through the expansion process.Can someone please suggest the steps to change the generated normal user to admin level please, or if maybe I'm going about this the wrong way?  I have consulted the following doco but no joy. https://nifi.apache.org/nifi-docs/administration-guide.html#creating-users-groupsI have sp

 Error importing NiFi workflow template from version 1.x to 2.xI'm having trouble migrating my NiFi workflow from version 1.9.2 to version 2.0 using the export template and import template functions. Any assistance would be greatly appreciated.

Hello,I've installed nifi 2.6 registry security - then I've scanned it in AWS Inspector, it shows me the following results:0 Critical.12 High.12 Medium.Could anyoune confrim the results? And if this is a stable security version?

Hello there, I'm having a problem while trying to start a newly added node's yarn NodeMgr.When I start it via Cloudera Manager console, I've got this in logs:2025-12-09 10:15:52,431 ERROR org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Unexpected error starting NodeStatusUpdaterorg.apache.hadoop.yarn.exceptions.YarnRuntimeException: Received SHUTDOWN signal from Resourcemanager, Registration of NodeManager failed, Message from ResourceManager: Disallowed NodeManager from cloudera06apl.claro.amx, Sending SHUTDOWN signal to the NodeManager.at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:426)at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:272)at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)at org.apache.hadoop.service.AbstractService.start(Abs

Hi Team,We are on CDP 7.1.9 SP1 and on OS version RHEL 7. As RHEL 7 is EOL we are planning to upgrade to RHEL 8 and also mysql 5.7 to 8.  Since it is production environment we are little bit concerned how complex it would be. Our CM services and mysql database of cm and application are residing on the same node.Kindly suggest apart from taking mysqldump backups and exporting the database/table what else we need to take care of post OS upgrade to rhel 8, I mean I am aware of re-installing el8 cm packages but for mysql we have to install from rpms of el8 so finding it little tricky.

Hello community, greetings again. I'm currently analyzing how to migrate from NIFI 1.11.4 to 2.0. My strategy is to create and export my workflow template to version 1.9.2, which worked correctly. Now, from there, I want to migrate to version 2.0. Using the same method, all of this done locally on Windows, to later install the final version of the NiFi cluster from a Docker image, the problem I encountered is that version 2.0 of NiFi requires a username and password. Upon reviewing comments and documentation on the matter, I see that they indicate extracting the user from the nifi-app.log file, searching for "0" in the "Generated Username" file, but that doesn't appear in my log file, and I also can't find the Windows command to generate the user; I only see it for Linux. My question is, is there any method to generate users in Windows, or is there any... HOW TO DEFINE IT IN THE login-identity-providers.xml FILE?

When I try to run a query against the nifi 2.5.0 API to get info about provenance activities, it seems to be quite difficult.I installed NIfi on my PC with no modifications and all default settings, and just use the default user and password that's created when you install it.I run this in my local windows CMD window and get   "unknown error" :curl --insecure -X DELETE -H "Authorization: Bearer <my token> " https://localhost:8443/nifi-api/provenance/queriesThen I run this and get : curl --insecure -X DELETE -H "Authorization: Bearer <token>" https://localhost:8443/nifi-api/provenance/queries > test.txtIn text.txt file I get :"An unexpected error has occurred. Please check the logs for additional details."I'm starting to think the Provenance part of the API might be broken as it shouldn't be this hard?I ran other API queries and they work fine.What I'm trying to do is get a list of all files that have passed through my small local nifi installation so we ca

I need to pull data from pager duty that needs a date in the url.  This is an example:https://api.pagerduty.com/oncalls?include%5B%5D=users&schedule_ids%5B%5D=AAAAAA&schedule_ids%5B%5D=BBBBBB&schedule_ids%5B%5D=CCCCCC&schedule_ids%5B%5D=DDDDDD&since=2025-12-04&until=2025-12-05&earliest=trueThe two parameters are since and until.  The intent is this runs once a day and a new date value set for each day.  Something tells me it may look like this:https://api.pagerduty.com/oncalls?include%5B%5D=users&schedule_ids%5B%5D=AAAAAA&schedule_ids%5B%5D=BBBBBB&schedule_ids%5B%5D=CCCCCC&schedule_ids%5B%5D=DDDDDD&since=#{since_date}&until=#{until_date}&earliest=true but the how I don't know.  I'll continue searching, but if anyone has a solution I will be thankful.

Hello,In Cloudera Data Flow, how should an InvokeHTTP processor be configured to be able to invoke the underlying nifi's rest api? I've tried several (localhost, with and without ssl etc.) options, but the connection is always refused.Thanks,Peter