Solved

Hi,what changes we need to be made if we need to change the ip address of the master and worker servers? Thanks

I added anew worker to the CDSW cluster and the status of this worker is false,In the logs I gut this message:Unable to connect to the server: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "kubernetes")  

Hello,We need to export Cloudera Manager audit logs (not to be confused with Ranger audit logs) to some external system.Previously (in CDH) they were Navigator logs, but these are not present anymore.Is there any solution for exporting these logs?I know they are available on /cmf/history endpoint, but maybe there is some more convenient way of reading them? Best regards,Aleksander

HI We are currently trying to restart the HDFS name nodes in our cluster (HA). It seems that we are not able to start them. The process of restarting the node takes a long time until it finally fail with the following output on AMBARI: Operation failed: Call From XX-XXX-XX-XXXX.XXXXX.XX/XX.X.XX.XX to XX-XXX-XX-XXXX.XXXXX.XX:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused2021-12-16 17:02:46,616 - call returned (255, '21/12/16 17:02:46 INFO ipc.Client: Retrying connect to server: XX-XXX-XX-XXXX.XXXXX.XX/XX.X.XX.XX:8020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=1, sleepTime=1000 MILLISECONDS)\nOperation failed: Call From XX-XXX-XX-XXXX.XXXXX.XX/XX.X.XX.XX to XX-XXX-XX-XXXX.XXXXX.XX:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefuse

Hello, After upgrading to CM 7.4.4/CR 7.1.7 the Activity Monitor never starts. It is always down and cannot be started after multiple attempts. It gives error messages below any thoughts?Command (Start this Activity Monitor (17683)) has failedSupervisor returned FATAL. Please check the role log file, stderr, or stdout.The health test result for ACTIVITY_MONITOR_SCM_HEALTH has become bad: This role's process failed to start.STDOUT messages:13:06:12.204 [main] ERROR org.hibernate.engine.jdbc.batch.internal.BatchingBatch - HHH000315: Exception executing batch [java.sql.BatchUpdateException: Data truncation: Out of range value for column 'METRIC_ID' at row 1], SQL: insert into CMON_METRIC_INFO (NAME, METRIC_ID) values (?, ?)13:06:12.209 [main] ERROR org.hibernate.engine.jdbc.spi.SqlExceptionHelper - Data truncation: Out of range value for column 'METRIC_ID' at row 1Sat Dec 18 13:06:17 EST 2021JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.292.b10-1.el7_9.x86_64CONF_DIR=/var/run/cloud

I need  password when I downloaded new version(Ambari 2.7.5 and HDP 3.1.5).I read the document from here(https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/bk_ambari-installation/content/access_ambari_paywall.html),and then I opened url(https://my.cloudera.com) in the document and did not know how to get the user and password.So, aren't they open source anymore?

Cannot display the number of topics and information about each topic when using cmd (zookeeper state changed (SyncConnected)) 

Hi Team, I am working on a mule integration project and so need to access the Impala database. I am using a generic database connection with the ImpalaJDBC42.jar as the maven dependency. Mule app uses maven plugin to build the app first even before trying to test database connections.I am getting the following error (abridged version of the stacktrace):Caused by: org.eclipse.aether.resolution.DependencyResolutionException: Failed to collect dependencies at Impala:ImpalaJDBC42:jar:2.6.24.1029.....Caused by: org.eclipse.aether.collection.DependencyCollectionException: Failed to collect dependencies at Impala:ImpalaJDBC42:jar:2.6.24.1029Caused by: org.eclipse.aether.resolution.ArtifactDescriptorException: Failed to read artifact descriptor for Impala:ImpalaJDBC42:jar:2.6.24.102.....Caused by: org.apache.maven.model.building.ModelBuildingException: 3 problems were encountered while building the effective model for Impala:ImpalaJDBC${env.JDBC_V}:${env.MAJOR_V}.${env.MINO

Hi experts,Can someone please explain the difference between volumes and folders in hadoop? Thanks,

I'm using CDH version 5.13, but I can't see the bdr function! Help!!!

hello all, We are using Nifi to do an incremental load from SQL Server using QueryDatabaseTableRecord where max-value column is updated_at column with a Datetime2 data type. The source tables get updated in milliseconds. We noticed that we are losing few events doing with each QueryDatabaseTableRecord run. As a work-around we created a custom processor that subtracts few seconds from the max-value in the state fetching overlapping events and then we handle any duplicates later on in the pipeline and it seems to solve the issue. However, this is not optimal. We'd like to know what's causing the skips. Our assumption so far is that timestamp datatype accuracy is causing the skips in the incremental load however we're not sure.   

I get a file with multiple dates in the following format: 2021-08-25T12:34:48.984704 which is in micro format. How could I change these dates on the nifi to stay in millis? I tried the following: Apache Nifi Expression Language - toDate formatting formatting but I was not successful in the configuration. I believe that the answer is cohort, but I am not managing to make it work.

Hello all,I am getting issues after starting NIFI (LDAP enabled). I started successfully to log in my NIFI, but all components are disabled as below.I guess the problem may be in setting at authorizers.xml, but I couldn't find anything from there. Below is my authorizers.xml. Could you please give me any ideas for this issue? Thank you in advance.    <?xml version="1.0" encoding="UTF-8" standalone="yes"?><authorizers> <userGroupProvider> <identifier>file-user-group-provider</identifier> <class>org.apache.nifi.authorization.FileUserGroupProvider</class> <property name="Users File">./conf/users.xml</property> <property name="Legacy Authorized Users File"></property> <property name="Initial User Identity 1">cn=admin,dc=ananas,dc=com</property> </userGroupProvider> <accessPolicyProvider> <identifier>file-access-policy-provide

Dears, We have two node using embedded Zookeeper. The first node ran okay but the second node it always disconnects from the cluster with this error:  CONNECTING to DISCONNECTED due to Proposed configuration is not inheritable by the flow controller because of flow differences: Found difference in Flows: Local Fingerprint: s.email.ConsumeIMAPNO_VALUEorg.apache.nifinifi-email-nar1.13.210 sec30 sec1 secWARNfalseTIMER_DRIVENPRIMARY0Mark Messages as Read=truefolder=Inboxhost=outlook.office365.commail.imap.socketFactory.clas Cluster Fingerprint: s.email.ConsumeIMAPNO_VALUEorg.apache.nifinifi-email-nar1.13.210 sec30 sec1 secWARNfalseTIMER_DRIVENALL0Mark Messages as Read=truefolder=Inboxhost=outlook.office365.commail.imap.socketFactory.class=ja   BTW, using Nifi 1.13.2

Hi Team ,    Unable to change interpreter  by user , need to enable multiple user support .one admin user to be activate. Error attached on interpreter

I need a small help in modifying the JSON file by a content of its own object. My Json array looks like below [ { "firstName": "John", "lastName": "Wick" }, { "firstName": "Lisa", "lastName": "Tandon" }]   The final output expected is as below   [ { "firstName": "John", "lastName": "Wick", "fullName": "John Wick" }, { "firstName": "Lisa", "lastName": "Tandon", "fullName": "Lisa Tandon" }]   I have tried with ReplaceText, but not able to access content inside Json. PS: Won't be able to make Json to attribute and back to AttributeToJson as data is huge considering number of parameters (all not listed above)   Can anyone help me what should be replaceText formula or Jolt formula

How to suppress below INFO and WARNING messages using log4j.properties log4j:WARN No appenders could be found for logger (com.ibm.connect.shadow.parquet.crypto.EncryptionPropertiesFactory).log4j:WARN Please initialize the log4j system properly.log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new compressor [.snappy] 

I am trying to create a table using the CREATE TABLE statement, in hue it works perfectly but when I use the dbexecute function in r, I get an error. How could it be solved.   library(DBI)library(odbc)con_Hive <- dbConnect(odbc::odbc(), "Hive_produccion", database = "cld_ml_bi_eng", encoding = "latin1")con_HivedbExecute(conn = con_Hive, statement = "CREATE EXTERNAL TABLE iris(sepal_length double, sepal_width double, petal_length double, petal_width double, species varchar(10))LOCATION '/sandbox/CLD_ML_BI_ENG/iris'")Error: nanodbc/nanodbc.cpp:1655: 42000: [Cloudera][Hardy] (80) Syntax or semantic analysis error thrown in server while executing query. Error message from server: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user [RDIAZ] does not have [CREATE] privilege on [default/iris] <SQL> 'CREATE EXTERNAL TABLE iris(se

Hi Guys, I'm pretty new in this world of CDP, and I would like to know if I have a CDP Private Cloud license, but in a short time, I will migrate to a CDP Public cloud.The same License that I have purchased for Private cloud, works for Public Cloud?Or I need to purchase a new license for CDP Public Cloud?Thanks in advance,Alfonso C.

Hello everyone, I am new for big data framework. Currently I am working for collect many type of files from ftp/sftp server and put in HDFS. I just research about apache Nifi it good to go, but the interface look not good to monitor because all flow in the same place. Anyone have more experience about this could you recommend the best framework for this task?   Thanks,  

Hi,is it possible to get the pdf version of CDP Documentation?https://docs.cloudera.com/cdp/latest/index.html Thank you, best regards 

Hello, I'm using Hue to visualize document indexed in SolR.I would like to Hide from Hue some field that are part of the SolR collection schema.The image below is what I see from Hue when I open a indexed document, I would like to know if it is possible (and how), hide the yellow fields from Hue. This is the schema used to create the SolR collection:I've tried to set stored=false and indexed=false but this seems to have no effect. Could you please provide some hint? Thanks

Hello! I'm getting files from a SMB with GetSMBFile, eventually they'll be placed on S3 with PutS3Object, the problem is the path contains "\" on it and I need to replace all of those to "/", I attempted a simple ${path:replaceAll('\','//')}/${filename} on the Object Key but it didn't work. What's the proper way to do this on NiFi?

I'm loading the pyspark(spark-2.4 & python-3.7.4) data frame to Hive using Hivewarehouseconnector. Hive tables are partitioned and orc formatted. Data frame can contain multiple partition values. I need to load those partition values in single load and overwrite if that partition was already exists.   df.select(columns).write\.format(HiveWarehouseSession().HIVE_WAREHOUSE_CONNECTOR)\.mode('overwrite')\.option('inferSchema', 'true')\.option('table','tablename')\.option('partition','partition_column')\.save()   Got the below error. I'm passing right partition column name.Caused by: java.lang.IllegalArgumentException: Invalid partition spec: partition_column. Even in append mode, it's not working. I'm getting same error. How to accomplish the load? Kindly help. 

In my project I am synchronizing neo4j data with mysql by using nifi to connect to kafka and neo4j plugin Streams to bring the data from kafka to neo4j. Inside nifi I have this structureQuerydatabasetable -> UpdateAttribute -> PublishKafkaRecordIt triggers on any change and gets updated data, but to be able to optimize my neo4j code I need to know the type of query triggered in sql (insert, update, delete). It seems that I can't get it with Querydatabasetable processor, so which processor I should use for that purpose?