About chhaya_vishwaka

chhaya_vishwaka · ‎02-04-2021

Hi @GangWar I did do policy "validate" and did not received any error. but replication still fails not sure where can I look for error.

chhaya_vishwaka · ‎02-04-2021

Hi All, I'm trying to remove registered classic cluster from CDP console I do not see any option to do that, can someone please help ?

chhaya_vishwaka · ‎02-02-2021

Hi Everyone, I'm trying to replicate data from on-premise CDH 6.3.2 to CDP public cloud on Azure. below are steps I followed. 1. Registered on premise CDH cluster onto CDP console under "Classic Clusters" 2. Added Azure credential in Replication Manager ( also created Azure datalake for storing replicated data ) 3. Created replication policy. Every time I try to run the policy it fails and I can not see any error log. Please help to advise. attached are screenshots for error and settings done so far, not sure if I'm missing something here. Any help would be appreciated.

chhaya_vishwaka · ‎01-05-2021

@GangWar thank you so much for your help I assigned myself as "Power User" and it worked like charm. However I'm bit surprised as my user is admin user still I had to assign a power user role.

chhaya_vishwaka · ‎01-04-2021

@GangWar any suggestion how to go about resolving this issue ?

chhaya_vishwaka · ‎01-03-2021

Hi @GangWar thank you for your reply. I tried Developer tool and I'm getting error as attached, could you suggest a possible fix ?

chhaya_vishwaka · ‎01-03-2021

@Shelton thank you for your response I did go through prerequisite and support matrix, it looks ok. My on premise cluster is running on CDH&CM 6.3.0. Do let me know if you have more inputs

chhaya_vishwaka · ‎12-23-2020

Hi Everyone. I already have a Data Lake and Data Hub running in my CDP environment but I’m having issues with registering the ‘Classic Clusters’. After clicking ‘Get Started’ the next screen is basically a blank page? Attached are screenshots for reference. Please help to provide your inputs. Appreciate your help

chhaya_vishwaka · ‎11-30-2020

Hi Everyone, I am trying to register CDP environment onto Azure using management console, but process is failing in provisioning FreeIPA. attached are screenshot for the issue, could somebody help to resolve this issue or point me into right direction? I could see following resources in Azure - Vnet and subnet - Postgres DB - FreeIpA storage account and VM Image

chhaya_vishwaka · ‎02-16-2020

Hi @gzigldrum I indeed followed documentation and used below commands to grant required access; CREATE DATABASE rman DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci; GRANT ALL ON rman.* TO 'rman'@'%' IDENTIFIED BY 'rman2019'; GRANT ALL ON rman.* TO 'rman'@'localhost' IDENTIFIED BY 'rman2019';

chhaya_vishwaka · ‎02-14-2020

Hi All, I'm trying to install cloudera 6.2.0 , however am stuck with below error. Provided username, dbname and password correct, I tried same credentials to connect to DB from backend and it works. [root@tdicsadn01 cloudera-scm-server]# cat db.properties # Auto-generated by scm_prepare_database.sh on Fri Feb 14 17:51:09 +08 2020 # # For information describing how to configure the Cloudera Manager Server # to connect to databases, see the "Cloudera Manager Installation Guide." # com.cloudera.cmf.db.type=mysql com.cloudera.cmf.db.host=localhost com.cloudera.cmf.db.name=scm com.cloudera.cmf.db.user=scm com.cloudera.cmf.db.setupType=EXTERNAL com.cloudera.cmf.db.password=scm2019 [root@tdicsadn01 cloudera-scm-server]# No firewall or Selinux [root@tdicsadn02 jdk1.8.0_181-cloudera]# getenforce Disabled [root@tdicsadn02 jdk1.8.0_181-cloudera]# systemctl status firewalld ● firewalld.service - firewalld - dynamic firewall daemon Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled) Active: inactive (dead) Docs: man:firewalld(1) [root@tdicsadn02 jdk1.8.0_181-cloudera]#

chhaya_vishwaka · ‎02-11-2020

@MattWho I deleted local NIFI state directory and it worked like magic :), I finally have my first 7 node secured NIFI cluster accessible using client cert. Thanks a ton for your valuable inputs and detailed explanations without which I might have been still stuck, highly appreciated.

chhaya_vishwaka · ‎02-11-2020

@MattWho from here does nifi picks up node Information for forming cluster ? Is this information stored in some directory or file?

chhaya_vishwaka · ‎02-11-2020

@MattWho ill try to delete local state directory and restart nodes , is there anything else I should look into ?

chhaya_vishwaka · ‎02-10-2020

@MattWho thanks for the inputs I was able to resolve user certificate issue, but my UI is stuck with below issue. I' m not sure why its still referring to http port. It's kind of weird , can you please advise ? java.net.ConnectException: Failed to connect to hostname/ip:8080

chhaya_vishwaka · ‎02-09-2020

@MattWho I added client certificate in my browser . Below are steps i followed I setup initial admin indentity in nifi conf as "Admin" Got client cert for "Admin" from IT team added cert in my browser. Below is logline from my nifi-user.log. "2020-02-10 11:18:54,677 INFO [main] o.a.n.a.FileAccessPolicyProvider Populating authorizations for Initial Admin: Admin 2020-02-10 11:18:54,693 INFO [main] o.a.n.a.FileAccessPolicyProvider Authorizations file loaded at Mon Feb 10 11:18:54 SGT 2020 2020-02-10 11:19:12,609 INFO [NiFi Web Server-48] o.a.n.w.a.c.IllegalStateExceptionMapper java.lang.IllegalStateException: Kerberos ticket login not supported by this NiFi.. Returning Conflict response. 2020-02-10 11:19:12,641 INFO [NiFi Web Server-36] o.a.n.w.a.c.IllegalStateExceptionMapper java.lang.IllegalStateException: OpenId Connect is not configured.. Returning Conflict response." 2020-02-10 11:19:12,666 INFO [NiFi Web Server-48] o.a.n.w.s.NiFiAuthenticationFilter Attempting request for (CN=nifi-host1, OU=nifi, O=Liongate, L=nifi, ST=SG, C=SG) GET https://localhost:8443/nifi-api/flow/current-user (source ip: <ip>) 2020-02-10 11:19:12,673 INFO [NiFi Web Server-48] o.a.n.w.s.NiFiAuthenticationFilter Authentication success for CN=nifi-host1, OU=nifi, O=nifi, L=SG, ST=SG, C=SG 2020-02-10 11:19:12,738 INFO [NiFi Web Server-48] o.a.n.w.a.c.AccessDeniedExceptionMapper identity[CN=nifi-host1, OU=nifi, O=nifi, L=SG, ST=SG, C=SG], groups[] does not have permission to access the requested resource. Unable to view the user interface. Returning Forbidden response. 2020-02-10 11:22:11,245 INFO [main] o.a.n.a.FileUserGroupProvider Users/Groups file loaded at Mon Feb 10 11:22:11 SGT 2020

chhaya_vishwaka · ‎02-06-2020

I'm stuck user certificate step if someone can help to understand on how to get these certs my nifi UI give "Insufficient Permissions"

chhaya_vishwaka · ‎02-06-2020

Hi @justin_brock Believe you were able to fix certificate issue ? I'm have enables ssl for NIFI in CDF but facing "ERR_BAD_SSL_CLIENT_AUTH_CERT" here is link to my question of community https://community.cloudera.com/t5/Support-Questions/Unable-to-open-NIFI-web-UI-after-TLS/m-p/289190#M214098 could you please help me with steps you followed to resolve issue ?

chhaya_vishwaka · ‎02-06-2020

Hi @MattWho I have checked configurations as mentioned by you but still I'm stuck at same issue, can you advise ?

chhaya_vishwaka · ‎02-05-2020

Hi All, I enabled TLS for NIFI web UI ( CDF ) , while services are running fine on cluster I'm unable to access NIFI web UI from my browser. Below are the steps I followed please suggest what might be causing issue ? I repeated below steps for all the machines in my nifi cluster 1. Received signed host certificate from IT team ( <hostname>.pem ) , also rootca (root.pem) 2. Copy the JDK cacerts file to jssecacerts as follows: sudo cp $JAVA_HOME/jre/lib/security/cacerts $JAVA_HOME/jre/lib/security/jssecacerts 3. import rootca cert into JKS store sudo $JAVA_HOME/bin/keytool -importcert -alias rootca -keystore $JAVA_HOME/jre/lib/security/jssecacerts -file /opt/cloudera/security/pki/root.pem 4. Created JKS and imported host certificate in keystore. $JAVA_HOME/bin/keytool -genkeypair -alias $(hostname -f) -keyalg RSA -keystore /opt/cloudera/security/pki/$(hostname -f).jks -keysize 2048 -dname "CN=$(hostname -f),OU=Engineering,O=Cloudera,L=Singapore,ST=Singapore,C=Singapore" -ext san=dns:$(hostname -f) sudo $JAVA_HOME/bin/keytool -importcert -alias $(hostname -f) -file /opt/cloudera/security/pki/$(hostname -f).pem -keystore /opt/cloudera/security/pki/$(hostname -f).jks 5. creating symlinks sudo ln -s /opt/cloudera/security/pki/$(hostname -f).pem /opt/cloudera/security/pki/agent.pem sudo ln -s /opt/cloudera/security/pki/$(hostname -f).jks /opt/cloudera/security/pki/server.jks 6. Enabled TLS from Cloudera Manager for NIFI 7. Restarted services from Cloudera manager 8. Unable to access from Browser

chhaya_vishwaka · ‎02-05-2020

thanks @paras

chhaya_vishwaka · ‎01-30-2020

Hi All, I'm trying to enable TLS for Cloudera Manager admin console , below are the commands I followed. 1. Received signed host certificate from IT team ( <hostname>.pem ) , also rootca (root.pem) 2. Copy the JDK cacerts file to jssecacerts as follows: sudo cp $JAVA_HOME/jre/lib/security/cacerts $JAVA_HOME/jre/lib/security/jssecacerts 3. import rootca cert into JKS store sudo $JAVA_HOME/bin/keytool -importcert -alias rootca -keystore $JAVA_HOME/jre/lib/security/jssecacerts -file /opt/cloudera/security/pki/root.pem 4. Created JKS and imported host certificate in keystore. $JAVA_HOME/bin/keytool -genkeypair -alias $(hostname -f) -keyalg RSA -keystore /opt/cloudera/security/pki/$(hostname -f).jks -keysize 2048 -dname "CN=$(hostname -f),OU=Engineering,O=Cloudera,L=Singapore,ST=Singapore,C=Singapore" -ext san=dns:$(hostname -f) sudo $JAVA_HOME/bin/keytool -importcert -alias $(hostname -f) -file /opt/cloudera/security/pki/$(hostname -f).pem -keystore /opt/cloudera/security/pki/$(hostname -f).jks 5. creating symlinks sudo ln -s /opt/cloudera/security/pki/$(hostname -f).pem /opt/cloudera/security/pki/agent.pem sudo ln -s /opt/cloudera/security/pki/$(hostname -f).jks /opt/cloudera/security/pki/server.jks 6. Enabled TLS from Cloudera Manager admin console Property Description Cloudera Manager TLS/SSL Server JKS Keystore File Location The complete path to the keystore file. For example: /opt/cloudera/security/pki/server.jks Cloudera Manager TLS/SSL Server JKS Keystore File Password The password for the /opt/cloudera/security/jks/server.jks keystore. Use TLS Encryption for Admin Console Check this box to enable TLS encryption for Cloudera Manager. 7. Restart Cloudera Manager server Cloudera manager starting successfully however I'm not able to open admin console from browser sudo netstat -tulpn | grep 7183 tcp 0 0 0.0.0.0:7183 0.0.0.0:* LISTEN 4664/java I'm getting below error on browser page This site can’t provide a secure connection 1.1.1.1 uses an unsupported protocol. ERR_SSL_VERSION_OR_CIPHER_MISMATCH Unsupported protocol The client and server don't support a common SSL protocol version or cipher suite. Can someone please suggest what am I missing here ?

chhaya_vishwaka · ‎09-28-2019

Hi I created the DB and recreated it later once error started coming, also this error goes away after a while but CM Server still not starting

chhaya_vishwaka · ‎09-27-2019

Hi All, I'm trying to install Cloudera manager 6.3.0 on Centos 7.6. But when I start cloudera-scm-server its not starting, there is nothing much in cloudera-scm-server.log. Below is tail of log file. main:com.cloudera.cmon.components.CsdMetricSchemaGenerator: Loading monitoring definitions from /mdls/cdh5/oozie.mdl 2019-09-27 16:24:20,493 INFO main:com.cloudera.cmon.components.MetricSchemaUpdate: persisting 0 new metrics 2019-09-27 16:24:20,493 INFO main:com.cloudera.cmon.components.MetricSchemaUpdate: persisting 0 updated metrics 2019-09-27 16:24:20,497 INFO main:com.cloudera.cmon.components.MetricSchemaManager: CSD metrics processed. 2019-09-27 16:24:20,497 INFO main:com.cloudera.cmon.components.MetricSchemaManager: Registering cross entity aggregates... 2019-09-27 16:24:22,267 INFO main:com.cloudera.cmon.components.MetricSchemaUpdate: persisting 0 new metrics 2019-09-27 16:24:22,268 INFO main:com.cloudera.cmon.components.MetricSchemaUpdate: persisting 0 updated metrics 2019-09-27 16:24:22,269 INFO main:com.cloudera.cmon.components.MetricSchemaManager: Cross entity aggregates processed. 2019-09-27 16:24:22,990 INFO main:com.cloudera.cmon.MetricSchema: Setting current metrics schema to IN3dTiKfJ0y_QA4FqV_ZXPx7ZHg 2019-09-27 16:24:23,253 INFO main:com.cloudera.cmon.components.MetricSchemaManager: Metric schema initialized in PT5.046S. 2019-09-27 16:24:23,637 INFO main:com.cloudera.parcel.components.PeriodicParcelTasks: Set up periodic parcel tasks every 60 minutes. 2019-09-27 16:24:23,663 INFO ParcelUpdateService:com.cloudera.parcel.components.LocalParcelManagerImpl: Found files under /opt/cloudera/parcel-repo 2019-09-27 16:24:23,706 INFO main:com.cloudera.server.cmf.components.ScmActive: ScmActive started. 2019-09-27 16:24:23,728 INFO main:com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder: ClouderaManagerMetricsForwarder started. 2019-09-27 16:24:26,694 ERROR ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: Failed to download manifest. Status code: 404 URI: <a href="https://archive.cloudera.com/sqoop-teradata-connector1/1.7.1c6/manifest.json" target="_blank">https://archive.cloudera.com/sqoop-teradata-connector1/1.7.1c6/manifest.json</a> 2019-09-27 16:24:38,720 INFO ScmActive-0:com.cloudera.server.cmf.components.ScmActive: ScmActive completed successfully. Attached is screenshot can someone please advise what might be wrong ? At start i also get below error but it goes away after a while Java version - Oracle jdk1.8u181 mariadb - 5.5.64

chhaya_vishwaka · ‎09-18-2019

How can the change the location of content_repository in CDF (Ni-Fi)?

chhaya_vishwaka · ‎09-02-2019

Hi All, I'm looking for a way to trigger Oozie from NIFI, however there is no much help available on community on this. I found details on InvokeHTTP processor from NIFI to call Oozie rest API but I do not have an idea to configure this NIFI processor Can someone help ?

chhaya_vishwaka · ‎09-02-2019

@adelgacem can you share sample for how you invoked Oozie using InvokHttp processor? I'm trying to run Oozie workflow from NIFI it will be a great help if you can share NIFI processor configuration details.

chhaya_vishwaka · ‎08-16-2019

Hi All, Does CDH 6.2 support anaconda? If yes is there any documentation to refer for installing and using it.

chhaya_vishwaka · ‎07-25-2019

Hi All, I'm trying to install & start Cloudera manager 6.2.0 , but Cloudera-scm-server start failes with below error. I'm using MariaDB 10.4.6-MariaDB MariaDB Server for Cloudera Manager Database. 2019-07-26 11:36:22,233 INFO main:com.cloudera.enterprise.dbutil.DbUtil: Schema version table already exists. 2019-07-26 11:36:22,233 INFO main:com.cloudera.enterprise.dbutil.DbUtil: DB Schema version 5002. 2019-07-26 11:36:22,236 WARN main:org.springframework.context.support.GenericApplicationContext: Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'com.cloudera.server.cmf.TrialState': Cannot resolve reference to bean 'entityManagerFactoryBean' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityManagerFactoryBean': FactoryBean threw exception on object creation; nested exception is java.lang.RuntimeException: Unable to obtain CM release version. 2019-07-26 11:36:22,236 ERROR main:com.cloudera.server.cmf.Main: Server failed. org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'com.cloudera.server.cmf.TrialState': Cannot resolve reference to bean 'entityManagerFactoryBean' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityManagerFactoryBean': FactoryBean threw exception on object creation; nested exception is java.lang.RuntimeException: Unable to obtain CM release version. at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:359) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108) at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:634) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761) at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:867) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:543) at com.cloudera.server.cmf.Main.bootstrapSpringContext(Main.java:418) at com.cloudera.server.cmf.Main.<init>(Main.java:260) at com.cloudera.server.cmf.Main.main(Main.java:233) Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityManagerFactoryBean': FactoryBean threw exception on object creation; nested exception is java.lang.RuntimeException: Unable to obtain CM release version. at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:185) at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:103) at org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1640) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:254) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351) ... 17 more Caused by: java.lang.RuntimeException: Unable to obtain CM release version. at com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean.getPersistedCmRelease(EntityManagerFactoryBean.java:311) at com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean.checkVersionDoFail(EntityManagerFactoryBean.java:358) at com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean.getObject(EntityManagerFactoryBean.java:172) Caused by: javax.persistence.NoResultException: No entity found for query at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1446) at com.cloudera.cmf.persist.DbVersionDao.getVersion(DbVersionDao.java:53) at com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean.getPersistedCmRelease(EntityManagerFactoryBean.java:307) ... 26 more

chhaya_vishwaka · ‎07-22-2019

@Jay Kumar SenSharma can you please help on this ?

Online	Offline
Last Visited	‎03-10-2021 08:27 PM

Date Registered	‎06-30-2019 11:40 PM
Last Visited	‎03-10-2021 08:27 PM
Total Messages Posted	41

Re: Data replication from on -premise CDH 6.3.2 to...

Removing classic clusters from CDP

Data replication from on -premise CDH 6.3.2 to CDP...

Re: Unable to register ‘Classic Clusters’ in CDP

Re: Unable to register ‘Classic Clusters’ in CDP

Re: Unable to register ‘Classic Clusters’ in CDP

Re: Unable to register ‘Classic Clusters’ in CDP

Unable to register ‘Classic Clusters’ in CDP

CDP on Azure

Re: Unable to install cloudera-management services

Unable to install cloudera-management services

Re: Unable to open NIFI web UI after TLS

Re: Unable to open NIFI web UI after TLS

Re: Unable to open NIFI web UI after TLS

Re: Unable to open NIFI web UI after TLS

Re: Unable to open NIFI web UI after TLS

Re: Unable to open NIFI web UI after TLS

Re: Truststore Keystore Certificate error when usi...

Re: Unable to open NIFI web UI after TLS

Unable to open NIFI web UI after TLS

Re: Enabling TLS for Cloudera Manager admin consol...

Enabling TLS for Cloudera Manager admin console

Re: Cloudera manager not starting

Cloudera manager not starting

Change location of content_repository in CDF (Ni-F...

Calling Oozie workflow from NIFI

Re: How to use NiFi to launch a Oozie workflow job...

Anaconda on CDH 6.2

Unable to start cloudera manager 6.2

Re: Consuming Avro events from Kafka in Spark stru...