Solved

Hi! I am testing the integration between Cloudera Manager and HSM .For that purpose I have deployed a singe node cluster in my lab.  It consists of two virtual machines implemented in VMware: one manager and one host.Getting and error trying to complete Installing Cloudera Navigator Key HSM.Here are the steps I took: 1. mkdir -p /var/www/html/cloudera-repos/cm72. wget https://xxxxxx:xxxxxx@archive.cloudera.com/p/cm7/7.13.1.0/repo-as-tarball/cm7.13.1.0-redhat8.tar.gz -P /var/www/html/cloudera-repos/cm7/3. tar xvfz /var/www/html/cloudera-repos/cm7/cm7.13.1.0-redhat8.tar.gz -C /var/www/html/cloudera-repos/cm7 --strip-components=14. sudo chmod -R ugo+rX /var/www/html/cloudera-repos/cm75. In another ssh session, start a Python http.server in the /var/www/html directory. 6. Through vSphere launch a WEB console.7. Launch the browser and go to https://localhost:8900/cloudera-repos/ and verify the extracted files are present. Checked OK.8. cat /

Hi everyone,I'm a very new user and am currently using Nifi to design a system that will automatically download files from an SFTP server. I will be utilizing "Tracking Entities" as the listing strategy.However, sometimes I might need to re-download files from the server, so I need a method to clear/reset the state of the ListSFTP processor. All of the replies I looked at said to right-click, select "View State" and click on the "Clear State" link.But there's no such link, at least for 2.5.0 on my machine: I have the "filter" text box, a list where I can sort things by "key" or "value" and the "close" button. I'm at a loss as to how to do this.Another post suggested that I delete the directories storing the data used by ListSFTP, but a) I feel that that is not a very elegant solution, and b) can someone point out to me which directories are these?All help would be greatly appreciated.

Hi Expert,I've the incoming flowfile have a attribute somethings like cdc = 12. And I'd like to list file in the folder looks like /home/user/cdc=${cdc}.Because the listfile not required an incomming flowfile. So How can I achieve this?Thank you so much.

I cloned a cdp 7.3.1-1 one node that is kerb enabled, to connect to a kdc server in a different domain.During the kerberos wizard, I choose "Administration" | "security" | "Kerberos Credentials" | "Import KDC Account Manager Credentials", and put in valid username and password, then I get "kinit: Preauthentication failed while getting initial credentials"the same user name / pwd pair, I can do kinit xx@TEST.LAN, and get valid results from klist. So I know the credential is good. I have validated on the AD server, use delegation wizard to give add, modify delete rights to the user xx.If I run Generate Missing Credentials, I see "SIMPLE_PWD_STR='-x -D cloudera@old kdc server -w REDACTED'", and this refers to the old kdc server.So I need to know how to change the setting on ldaps and how I can solve the issue with kinit: Preauthentication failed while getting initial credentials

Just add a new node into the current cluster, and now I'm running the Balancer command to balance disk space into the new node.But the Balancer runs for so long, we're still waiting for it to complete before doing anything. We fear that reading/writing to HDFS while the Balancer is running will cause corrupted data files.Should we wait, or just work like normal

Hi..I don't see the Users and Policies items in the Global MenuGoogle Chrome ver99Apache NiFi 1.15.3  

Dear Cloudera team,@Bharati @jagadeesan We are currently using Cloudera 7.11.3, and Spark actions added via the UI are still being treated as Spark2. We would like to use Spark3 by default instead. How can we migrate or configure the system to ensure Spark3 is used for these actions? Best Regards,Modhi

Hi,I choose the wrong company name when I register. How can I change it. It cannot be edited in Profile.Thank you

Hi everyone, I need some quick help. I was doing some research on a tool that can help streamline the deployment of Apache NiFi flows across multiple environments. Does anyone know of any such tools, whether free or paid?

 Hi Cloudera Community/@@MattWho,I'm currently working with Apache NIFI version 1.28.1 and have successfully configured SAML authentication using an  Okta for UI login.I now need to access the NIFI REST API (/nifi-api) programmatically, but I'm facing challenges due to the nature of SAML being browser-based. Specifically, I’d like to know:What are the supported or recommended methods to access the NIFI API when SAML authentication is enabled?Is there a way to retrieve or reuse the JWT token issued after SAML login for API calls?Can NIFI processors or external scripts be used to automate token retrieval or API access in this setup?Are there any best practices or alternative authentication mechanisms (e.g., client certificates or hybrid setups) that can be used alongside SAML for API access?Any guidance or examples would be greatly appreciated!Thanks in advance.

Hello, guys!I still have a three-node cluster Apache NiFi 1.18.0 (yeap, upgrade task in by backlog =)) and trying to setup it behind HAProxy just for UI (/nifi endpoint).I wanna to implement a health check to balance user requests only to nodes in CONNECTED status to avoid issues when nodes moves to maintenance (offload, disconnect).Is it good idea, right? Or maybe I do some overengineering things? 😃By the way, I have next HAProxy config file:frontend nifi_443 bind *:443 ssl crt /etc/haproxy/ssl/cert_file.pem http-request set-path /nifi if { path / } mode http option httplog acl DST_IP dst 10.0.0.10 use_backend nifi_ui_9443 if DST_IPbackend nifi_ui_9443 mode http option httpchk http-check send meth GET uri /nifi-api/access/config ver HTTP/1.1 hdr Host nifi-cluster.corp.company.com http-check expect status 200 cookie SERVERID insert indirect nocache balance leastconn server srv_1 10.0.0.1:9443 check ssl verify none cookie web1 server srv_2 10.0.0.2:9443 check ssl verify

Hello Cloudera Support,We are receiving warnings in Cloudera Manager related to swapping activity on one or more cluster nodes. However, swap has already been disabled across all our hosts, and we've verified that no active swap space is configured. Despite this, Cloudera Manager continues to raise the warning.We would appreciate your assistance in clarifying the following:What conditions or metrics trigger this warning?Are there additional configurations or steps we should take to prevent this alert?Please let us know if any diagnostics or host information is required from our end.Thank you for your support. (Swap has been disabled across all nodes via OS configuration.) Best regards,Modhi Alrashed

Hi Team,             we have an issue with Nifi UI, which is unstable with multiple nodes (like 401 unauthorized error) but with single node it is working fine without any issue, For multiple nodes also UI coming but dropping off after sometime, and accesible to only to few  users randomlycoming to the background of this issue, we recently migrated our application from DHC CASS  to DYP CAAS (AWS), all configurations are fine and backend also working fine. only thing changed is the domain name (hostname changed) we replaced this latest hostname in all config files (users,nifi.properties, autherizations.xml, sts, deployment) wherever it is needed in place of Old domain name.from Browser network logs what we observed is 401 unauthorized error whenever its throwing error logs unauthorized Please check logs. and these errors everytime changing to different api's in the nifi not consistent, sometimes its coming with config, sometimes summary,

Hello Cloudera Support,We are running an environment based on Apache Ambari, where Apache Log4j 1.x is in use.The identified security vulnerabilities are:CVE-2019-17571 – Insecure deserialization via SocketServerCVE-2020-9488 – TLS certificate hostname validation issue in SMTPAppenderCVE-2022-23302 – Unprotected JNDI usage in JMSSinkSince Log4j 1.x has reached End of Life (EOL), no security updates are available.Additionally, in our Ambari environment, upgrading to Log4j 2 is not supported by Cloudera, and therefore version upgrade is not an option.QuestionsIs there a supported workaround for Log4j 1.x similar to the official solution (cloudera-scripts-for-log4j) you provided for Log4j 2.x vulnerabilities?Would manually removing the vulnerable classes (e.g., SocketServer.class, JMSSink.class, JMSAppender.class, SMTPAppender.class) from the Log4j 1.x JAR files cause any service interruptions or functional issues in Ambari or Hadoop components (HDFS, YARN, HBase, Hive, Kafka, etc.)?Are t

Hello Everyone,We are currently conducting tests and POCs to push (and potentially read) data from Kafka brokers and Azure Event Hubs.Event Hubs TestOur Event Hubs test worked successfully:We added the following NARs as extensions:nifi-azure-nar-2.4.0.narnifi-azure-services-api-nar-2.3.0.narAfter a manifest refresh in EFM, we were able to use the PutAzureEventHub processor.We configured the flow, published the new version, and confirmed that the MiNiFi agent could successfully send data to the Event Hub.Kafka Test IssueWe are now trying to create a flow in MiNiFi to push data into a Kafka topic.We followed the same steps as the Event Hubs test and added the following NAR files:nifi-kafka-service-api-nar-2.4.0.narnifi-kafka-nar-2.4.0.narWhat works:After refreshing the manifest, we can see two Kafka processors, including PublishKafka, which we need for the test.What doesn’t work:We cannot add the KafkaConnectionService, which is required to configure the PublishKafka processor.Even after

Hi Pros,Current version:Cloudera Manager 7.11.3.0Cloudera Runtime 7.1.7 SP1Upgrade version:Cloudera Manager 7.11.3.14 (CH7)Cloudera Runtime 7.1.9 SP1I'm in the midst of upgrading Cloudera 7.1.7 SP3 to Cloudera 7.1.9 SP1. I encountered error at  Install YARN MapReduce Framework JARs on service YARN. I have screenshot and full logs but unable to upload here due to no permission. Below is an extract of the error logs./user/yarn/mapreduce/mr-framework - have executable rights.Appreciate if anyone could point me to the answers.Thank you very much.25/07/18 12:59:43 ERROR uploader.FrameworkUploader: Error in execution /opt/cloudera/parcels/CDH-7.1.9-1.cdh7.1.9.p1000.55406660/lib/hadoop/./ozone-filesystem-hadoop3-1.4.0.7.1.9.1000-103.jar (Permission denied)java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-7.1.9-1.cdh7.1.9.p1000.55406660/lib/hadoop/./ozone-filesystem-hadoop3-1.4.0.7.1.9.1000-103.jar (Permission denied)at java.io.FileInputStream.open0(Native Method)at java.io.FileInp

Hi, everyone.We have a three-node Apache NiFi Cluster 1.18.0.Content archive is enabled (15 minutes deep), content repository is on it's own disk.Today we noticed that 2nd node use a lot of disk space by content repository (>80%). I've checked archive files and they fill only about 500 Mb disk space. Other space was used by current content data.Other nodes used content repo as usual -- about 25%.Because we start to receive next errors and 2nd node performance goes down, I've start 2nd node offloading (~ 13:10 on graph down below):Unable to write flowfile content to content repository container repo0 due to archive file size constraints; waiting for archive cleanup. Total number of files currently archived = 63After 2nd node was successfully offloaded I've connect it to the cluster again and now it works fine -- data processing, content repo uses as usual.But when offloading processed, I've track disk space utilization graphs and noticed that 1st and 3rd node did not utilize disk spa

Dear Team,I am trying to register the environment, I am using aws me-central-1 region. i am trying to register the environment . I am getting error on datalake provisioning . i am unable to proceed further on it. please do the needful.Error Message:Datalake creation failed. Data Lake creation failed on 'dl-aws-02' cluster. Reason: Stack status: CREATE_FAILED, cluster status: CREATE_FAILED, reason: Multiple exceptions occurred during resource creation: 1. Error reason: Cannot execute method: runInstances. You have requested more vCPU capacity than your current vCPU limit of 32 allows for the instance bucket that the specified instance type belongs to. Please visit http://aws.amazon.com/contact-us/ec2-request to request an adjustment to this limit. (Service: Ec2, Status Code: 400, Request ID: 365d46c8-898d-453e-b612-418ca5c8eaf8) 2. Error reason: Cannot execute method: runInstances. You have requested more vCPU capacity than your current vCPU limit of 32 allows for the instance bucket th

Hello,I have seen multiple sources (for example this press release) state that Cloudera and CrewAI have partnered and it should be easy to deploy a CrewAI project on the Cloudera AI Workbench, but I can't find any documentation about it and no option to do so in the UI.Does anyone know more about it or has maybe even already made a CrewAI project on Cloudera?Best Regards

Recently started getting the following error when attempting and odbc connection using 2.06.09.1009 windows 64-bit odbc driver:"[Cloudera][DriverSupport] (1100) SSL certificate verification failed because the certificate is missing or incorrect. (1100) (SQLDriverConnect); [HY000] [Cloudera][DriverSupport] (1100) SSL certificate verification failed because the certificate is missing or incorrect. (1100)"Upon further investigation using openssl against the cacerts.pem file we discovered there are several components in the pem file that have expired.Where can we get an update cacerts.pem file?Thanks. 

Hello,I am working on getting registry setup using docker and for some reason I can't seem to get LDAP authentication to work. This is a snippet of the error I am getting when I try to login:2025-07-17 19:24:09,286 DEBUG [NiFi Registry Web Server-28] o.s.s.l.authentication.BindAuthenticator Failed to bind with any user DNs []2025-07-17 19:24:09,447 DEBUG [NiFi Registry Web Server-28] o.a.n.r.s.ldap.LdapIdentityProviderorg.springframework.security.authentication.InternalAuthenticationServiceException: ldap.mydomain.com:686 at org.springframework.security.ldap.authentication.LdapAuthenticationProvider.doAuthentication(LdapAuthenticationProvider.java:190) at org.springframework.security.ldap.authentication.AbstractLdapAuthenticationProvider.authenticate(AbstractLdapAuthenticationProvider.java:80) at org.apache.nifi.registry.security.ldap.LdapIdentityProvider.authenticate(LdapIdentityProvider.java:247) at org.apache.nifi.registry.web.api.AccessResource.crea

We would like to automate the installation  / configuration of the Cloudera Manager instead of using the GUI.We are using ansible for the automation steps.We have uploaded the license file with the REST API call in ansible. This works fine. Now we try to import a cluster template that we took from another setup. We did some modification at that template and start to do the import via ansible. The import failed with an error that the cluster host can't are not available. The cluster hosts are available, they can be ping from the cloudera manager host.The cloudera-scm-agent are installed at cluster host and up and running.  The /var/log/cloudera-scm-server log shows two java exceptions and the following message The following host(s) are not available: test-22.vmlocal,test-23.vmlocal,test-21.vmlocal,test-24.vmlocal.2025-07-10 15:50:44,353 INFO scm-web-75:com.cloudera.api.ApiExceptionMapper: Exception caught in API invocation. Msg:The following host(s) are not

I am using MariaDB and CMS is up and running, but I am getting the following message in the logs for Reports Manager. I actually deleted the rman user, recreated the database, I logged into mysql with that user, but I am still getting access denied to the database. Any ideas?com.mchange.v2.resourcepool.BasicResourcePool$ScatteredAcquireTask@619cdccb -- Acquisition Attempt Failed!!! Clearing pending acquires. While trying to acquire a needed new resource, we failed to succeed more than the maximum number of allowed acquisition attempts (5). Last acquisition attempt exception: java.sql.SQLException: Access denied for user 'rman'@'dmidlkprdls01.svr.luc.edu' (using password: YES) at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:121) at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:113) at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:861) at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionI

Hello @MattWho ,I'm new to NIFI and Nifikop but I'm using terraform and helm to deploy NIFI on AKS with nifikop, it works well when configured with single-user-provider and overiding nifiproprites with oidc for azure AD, but when I tried to deploy it with file-user-groups provider all the pods kept running and then getting this error : Caused by: java.io.FileNotFoundException: ../data/users.xml (No such file or directory) at java.base/java.io.FileOutputStream.open0(Native Method) at java.base/java.io.FileOutputStream.open(FileOutputStream.java:289) at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:230) at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:179) at jakarta.xml.bind.helpers.Absand this is my helm chart :  # nifi.security.user.login.identity.provider=single-user-provider # nifi.security.user.authorizer=single-user-authorizer nifiProperties: overrideConfigs: | nifi.in

Hi everyone,I have been facing intermittent issues with a delete statement on a iceberg table v2.Below is the error I am having and I dont know what is causing it.Had anyone gone through the same issue?Thank you [HiveServer2-Background-Pool: Thread-1255]: Vertex failed, vertexName=Reducer 2, vertexId=vertex_1752069399412_0193_1_01, diagnostics=[Task failed, taskId=task_1752069399412_0193_1_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Node: xxxxx-compute0.xxxxx.ysv060.a0.cloudera.site/10.XX.XX.XX : Error while running task ( failure ) : attempt_1752069399412_0193_1_01_000000_0:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 1)at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)at org.apache.tez.runtime.LogicalIOP