Q&A

Hi everyone,Can i have something for Cloudera CDP 7.3.1 sandbox and practice env for deploying and upgrade. and other tasks like adding data services.Please do let me know 

Hello, All!I am sorry if the questions seems stupid, but I am a newbie. Is it possible to install cloudera on premises free trial version for on a single laptop for learning purposes?Or i need a cluster of laptops to be able to run cloudera and hadoop services? 

Hi, I am looking how to handle cases when json format may vary between different client responses. On response{"data": [{"ID": "123","Name": "Queen"},{"ID": "456","Name": "King"}]}we apply following jolt transform:[{"operation": "shift","spec": {"data": {"*": {"ID": {"456": {"@(2,Name)": "Name"}}}}}}]but some times response is coming without leading "{"data":and our transformation fails. So, generally, how can we query json with JOLT if we know for instance that Name and ID are next to each other somewhere in the structure?  

Hi I am using the CDP 5 days trail versionon the CDE I tried to add the Resource, for adding the resource we need the Virtual cluster, for creating the VC we need to enable the serviceon CDE, I tried to enable the service, on there couldn't able to select the environment, by default environment is there on the dropdown, but couldn't able to select that,i checked on the management console as well, the status is running and good health.for adding the resource it is asking to check with admin, i don't know who is the admin to connect,how to fix this to create the CDE VC. 

Hi!When I try:https://repository.cloudera.com/repository/cloudera-repos/org/eclipse/collections/eclipse-collections-api/maven-metadata.xmlI get a 500 error.curl -I "https://repository.cloudera.com/repository/cloudera-repos/org/eclipse/collections/eclipse-collections-api/maven-metadata.xml"HTTP/2 500date: Wed, 19 Nov 2025 16:42:49 GMTcontent-type: text/htmlcontent-length: 1596server: nginxx-content-type-options: nosniffcontent-security-policy: sandbox allow-forms allow-modals allow-popups allow-presentation allow-scripts allow-top-navigationx-xss-protection: 1; mode=blockx-frame-options: DENYcache-control: no-cache, no-store, max-age=0, must-revalidate, post-check=0, pre-check=0pragma: no-cacheexpires: 0

Current Issue:Recently, we have encountered a significant slowdown during NiFi cluster restarts. The startup process takes approximately 10 to 15 minutes, and the `nifi-app.log` indicates that NiFi is spending most of this time restoring components. For example, we see many log entries like: 2025-11-15 15:13:51,911 INFO [main] o.a.n.f.s.StandardVersionedComponentSynchronizer Added Connection[ID=70a5878d-0199-1000-ffff-ffff9a65a5f2, Source ID=7097063b-0199-1000-0000-0000565ddd06, Dest ID=7096bae9-0199-1000-ffff-ffffbae5c592] to StandardProcessGroup[identifier=70967de1-0199-1000-0000-00001dde7b99,name=Filter empty files]2025-11-15 15:13:51,913 INFO [main] o.a.n.f.s.StandardVersionedComponentSynchronizer Added Connection[ID=7097150c-0199-1000-ffff-ffffd3ea7bb1, Source ID=7096aedf-0199-1000-0000-000061416339, Dest ID=7097063b-0199-1000-0000-0000565ddd06] to StandardProcessGroup[identifier=70967de1-0199-1000-0000-00001dde7b99,name=Filter empty files]2025-11-15 15:13:51,914 INFO [main]

I am trying to read a json field from mySQL using executeSQLRecord and insert into snowflake VARIANT field type using PutDataBaseRecord in NiFi 2.6.0.its giving me this error "03:20:05 UTCERROR1695731e-9b6f-3cb8-5a9a-98ab38589597PutDatabaseRecord[id=1695731e-9b6f-3cb8-5a9a-98ab38589597] Failed to put Records to database for FlowFile[filename=c6087904-71a5-479c-9301-2c99883f5f59]. Routing to failure.: net.snowflake.client.jdbc.SnowflakeSQLException: SQL compilation error:Expression type does not match column data type, expecting VARIANT but got VARCHAR(2) for column JSON_STORE"how do I fix this? 

In Cluster mode, on Linux REDHAT 8 , (version NIFI 1.26), we have an error when we are trying to launch NIFI in service mode with command: systemctl start nifi.service.user to execute systemctl : rootfirst script executed by systemctl (start) : /etc/rc.d/init.d/nifi  In this script (line 28) will have to execute command : /install_directory/nifi/bin/nifi.shScript nifi.sh can be launched by everyone-rwxrwxr-x. 1 user usrgroup vy9 17308 Jul 24 10:49 nifi.sh In the journalctl log we have this trace:Oct 22 10:53:37 Serveur_Name nifi[110953]: /etc/rc.d/init.d/nifi: line 28: /install_directory/nifi/bin/nifi.sh: Permission deniedOct 22 10:53:37 Serveur_Name systemd[1]: nifi.service: Control process exited, code=exited status=126Oct 22 10:53:37 Serveur_Name systemd[1]: nifi.service: Failed with result 'exit-code'.I don't know which is wrong ...   

Hello,We are using hdfs 2.7.3, and we have set the storage policy of one folder to cold (Archive). We have restarted dediated services on the datanodes (the namenode services weren't asked to be restarted). I know that we have to launch a mover process to move the existing blocks which violate the storage policy. However, it looks like the new data is not automatically write into the cold storage and still need the mover. How does it work? Did I miss anything? Is there a way to make the block placement automatic to the cold storage location?*What I'm sure: the storage policy is applied (checked from getStoragePolicy and fsck command)Thank you. 

We want to move from NiFi 1.28.1 -> NiFi 2.4. We have done most of the prerequisites like using the json flow file not xml but are confused with the deprecation of the the ./tls-toolkit.sh. How are NiFi 2.0+ clusters secured? We are using helm charts. 

Hello dear community,I haven’t been able to find a solution for the following setup:I have Apache NiFi 2.5.0 and NiFi Registry 2.5.0 installed on the same EC2 instance (Linux 2023). Both NiFi and NiFi Registry are configured with SSL and served through an Application Load Balancer (ALB).External access is only available via the ALB: https://alb...com.Internally, the services can be reached at:NiFi: https://nifi_ec2server.com:8443/nifiNiFi Registry: https://nifi_ec2server.com:18443/nifi-registryAuthentication is handled via Active Directory (LDAP).Accessing NiFi through https://alb.../nifi works fine — I can log in as an LDAP user. The same applies to NiFi Registry under https://alb.../nifi-registry.The problem:As an LDAP user, I cannot access the NiFi Registry from within NiFi, and no buckets are displayed.The error message is attached below.[NiFi Registry Web Server-50] o.a.n.r.w.s.a.IdentityFilter Attempting to extract user credentials using X509IdentityProvider[NiFi Registry Web Ser

I’m currently working on a requirement to create a dashboard in Cloudera based on a data flow that is ingested via OCR (Optical Character Recognition).I’m completely new to Cloudera and still exploring its ecosystem. So far, I’ve found the Cloudera AI Technical Professional Accreditation, which seems helpful, but I’d like to know if there are any other specific learning paths, courses, or documentation that could guide me through this use case.My goal is to understand the end-to-end flow from OCR data ingestion → data processing → dashboard visualization within Cloudera.Any suggestions, resources, or recommended starting points would be greatly appreciated.

Hello Everyone,                          As you know that , it is recommended to use Parameter rather than variables in Nifi as it is gonna get deprecated soon.                         I have two process groups PG1 and PG1A. PG1A is the child process group to PG1.                        I have ParameterContext PC1 which has database and other common application configuration parameters and it is assigned to PG1.                        I would like to create new ParameterContext PC1A which has its own parameters specific to the process group PG1A and it should also inherit the common application parameters from PC1. How it can be achieved? Since we can't assign two different Parameter contexts(PC1 & PC1A) to one process group (PG1A)

I want to validate my JSON objects against an schema like this:{ "type": "object", "required": [ "apple", "banana", "orange" ], "properties": { "apple": { "type": "object", "required": [ "header", "enableAlert" ], "properties": { "header": { "type": "string" }, "enableAlert": { "type": [ "boolean", "string" ], "enum": [ true, false, "true", "false" ] } }, "additionalProperties": true }, "orange": { "type": "object", "required": [ "test1", "test2" ], "properties": {

 nifi is hosted in AKS cluster  of node count 3. occasionally we are receiving below errors and node-0  always gets disconnectedCould you please give some inputs or help possiblelogs:2025-11-01 01:01:12,444 INFO [Reconnect to Cluster] o.a.n.f.s.StandardVersionedComponentSynchronizer Updated UpdateAttribute[id=9b95428d-2972-38fa-b7cd-20d759b4e749]2025-11-01 01:01:12,445 INFO [Reconnect to Cluster] o.a.n.f.s.StandardVersionedComponentSynchronizer Updated ExecuteSQLRecord[id=07e8f117-fcdf-39a9-a989-3deb3b467263]2025-11-01 01:01:12,445 INFO [Reconnect to Cluster] o.a.n.f.s.StandardVersionedComponentSynchronizer Updated UpdateAttribute[id=2be213fa-1965-3303-9e4f-ebbb8e3dec37]2025-11-01 01:01:12,445 INFO [Reconnect to Cluster] o.a.n.f.s.StandardVersionedComponentSynchronizer Updated StandardProcessGroup[identifier=cd3be53f-130d-3a1c-8e5a-ed86de708fd8,name=fullload-process-configuration]2025-11-01 01:01:12,445 INFO [Reconnect to Cluster] o.a.n.f.s.StandardVersionedComponentSync

I try get json from API with help InvokeHTTP.In area Request OAuth2 Access Token Providers i used StandardOauth2AccessTokenProvider08:52:01 UTCERRORStandardOauth2AccessTokenProvider[id=2e9e7bd4-019a-1000-f83f-1ef5f5d2d56d] OAuth2 access token request failed [HTTP 400], response:{"error":"unsupported_grant_type","error_description":"The authorization grant type is not supported by the authorization server.","hint":"Check that all required parameters have been provided","message":"The authorization grant type is not supported by the authorization server."}

Hello!I have a NiFi 1.28 instance running on a Oracle Linux Server 9.6. I'm trying to connect to a Microsoft SQL Server database using a DBCPConnectionPool 1.28.1 controller, with a mssql-jdbc-13.2.1.jre11.jar driver, but I'm getting a very confusing error:Failed to establish Database Connection: java.sql.SQLException: Cannot create PoolableConnectionFactory ("encrypt" property is set to "false" and "trustServerCertificate" property is set to "true" but the driver could not establish a secure connection to SQL Server by using Secure Sockets Layer (SSL) encryption: Error: Certificates do not conform to algorithm constraints. Here is what I've already tried to fix this error:- Import the self signed certificate (from the database machine) into the $JAVA_HOME truststore- change the default cypto policy with: update-crypto-policies --set DEFAULT:SHA1- Relax the java security restrictions by going into the java.security file and commenting the jdk.certpath.disa

Hi everyone, I have a issue on Nifi 1.15.3 InvokeScriptedProcessor (Groovy), I set a custom property in sensitive in my processor, put for value a context parameter which is sensitive too, but when i'm trying to context.getProperty, it return the expression #{blahblah} instead of the value.This problem is "new", the flow was working, and one day, the token from sensitive value was not evaluated anymore... My property declaration :def externalRequestTokenDescriptor = new PropertyDescriptor.Builder().name("External request token")        .description("External request token")        .required(true)        .sensitive(true)        .addValidator(Validator.VALID)        .expressionLanguageSupported(true)        .build();Context param setup : Sensitive property setup :  How i get the property :context.getProperty("External request token").getValue();

I have a cdp 7.3.1 instance, and I want to hookup okta authentication to the impala service, so that when tableau connects to the impala, it will trigger authentication / call back with a okta server(I already have admin controls of it, and have scope/application etc).on this instance, I already enabled kerberos, knox and not sure if I need to enable ssl as well, I can't find any documentation for it, can some one walk me through the setup? I mostly rely on chapgpt, and had some issues.  

我的服务器由于硬盘故障导致服务器强制重启，重启之后再开启 DataNode 节点就报着错误，打开datanode日志，错误日志如下： 2025-10-27 09:57:18,577 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: supergroup = supergroup2025-10-27 09:57:18,610 ERROR org.apache.hadoop.jmx.JMXJsonServlet: getting attribute DatanodeNetworkCounts of Hadoop:service=DataNode,name=DataNodeInfo threw an exceptionjavax.management.RuntimeMBeanException: java.lang.NullPointerExceptionat com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.rethrow(DefaultMBeanServerInterceptor.java:839)at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.rethrowMaybeMBeanException(DefaultMBeanServerInterceptor.java:852)at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getAttribute(DefaultMBeanServerInterceptor.java:651)at com.sun.jmx.mbeanserver.JmxMBeanServer.getAttribute(JmxMBeanServer.java:678)at org.apache.hadoop.jmx.JMXJsonServlet.writeAttribute(JMXJsonServlet.java:346)at org.apache.hadoop.jmx.JMXJsonServlet.listBeans(JMXJsonServlet.java:324)at org.apache.hadoop.jm

Hello everyone,I am working with Apache NiFi and I encountered the following issue:The file I need to get is CaryIL-ASTUDENTDI-2025-03-18-083011.csv. The number of files in the list will change daily, and my goal is to get the file with the latest timestamp in the format yyyy-MM-dd-HHmmss.Specifically, I have 5 queues containing FlowFiles, and I want to merge all the FlowFiles into a single queue. After collecting the FlowFiles from these queues, I want to select the file with the most recent date based on the file name (which follows the yyyy-MM-dd-HHmmss.csv format), and move the FlowFile with the latest date into one queue for further processing. Please refer to the attached file.I also tried passing them through an ExecuteGroovyScript, but it seems that it processes each queue sequentially, not merging the 5 queues into one and then finding the Latest Date time. Below is the ExecuteGroovyScript code snippet.  def flowFiles = session.get()if (flowFiles != null && f

HelloI need to ask if its okey to upgrade our postgresssql DB (from 13.22 to 16 version) that we are using on our Cloudera cluster, we are using 7.11.3  cloudera manager with 7.1.9 SP1 runtime and RHEL 8.10. From support matrix it seems like we can but https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/administering-hue/topics/hue-download-install-postgres.htmlRHEL and CentOS 7 include PostgreSQL version 9.2. However, on these OS versions, Hue is compatible only with PostgreSQL versions 10, 11.x, 12, 13 and 14. Therefore, you must download and install the PostgreSQL distribution separately.Here is only maximum of 14 version

In Ranger, if a user is both an admin and an auditor then the auditor role is chosen.  I would prefer that the highest privilege is chosen so the user should be an admin.Is there a way to make Ranger pick Admin over Auditor?

Hi all, I have been seeing this problem increasingly now that the data gets stuck in between two different processors -- the data being as small as few KBswhat could be the cause of it? The ExecuteSQL contains an SQL insert script. Moreover, this behavior is random -- occurs randomly on any processor. Does my machine specs count in this? I see my CPU usage and memory are not choking as well.Any comments on this will be appreciated. Thanks

I have setup an ExecuteSQLRecord processor to get a list of files that were processed daily at 5pm and send this list via email. The process flow works as expected, except for the CRON schedule. My CRON expression is as follows:0 0 17 * * ?I believe this is correct to execute daily at 17:00 (5pm).However, the process flow executes daily at 16:07 (4:07pm) and 17:00 (5pm).I am scratching my head trying to figure out why the odd execution at 4:07pm.Does anyone have any insights to where I can check to see why this is happening?