Hi, I am running cdh 5.14.0 cluster version both on Prod and DR cluster. Both cluster are Kerberos and TLS enabled with the same kdc server. Could anyone guide me on how to do BDR between Kerberos enabled clusters. As I was not able to find any proper guide on the Cloudera website.   Please help me or provide any docs related to this. Appreciate your help.   Thanks  pdev ... View more

Hi, We were trying to enable TLS on our cluster.We have followed cloudera steps ,but i think missed something.After enabling TLS,we were able to login to port 7183,but all  cloudera management services were disabled.   So we reverted back TLS changes from cloudera and removed all keys and certificates.After that given restart to the cloudera manager.   After this process,port 7180 started and login page came.But when i am trying to login then it is not redirecting to the GUI. when i have check the logs. then these exceptions are showing.   2019-12-17 13:24:29,320 INFO WebServerImpl:com.cloudera.server.web.cmon.JobDetailGatekeeper: ActivityMonitor configured to allow job details for all jobs. 2019-12-17 13:24:30,850 WARN ActionablesProvider-0:com.cloudera.server.web.cmf.StatusProvider: Failed to submit task for getting status from SERVICE_MONITORING com.cloudera.cmon.MgmtServiceNotRunningException: SERVICE_MONITORING is not running   2019-12-17 13:24:50,238 WARN EventStorePublisherWithRetry-0:com.cloudera.cmf.event.publish.EventStorePublisherWithRetry: Failed to publish event: SimpleEvent{attributes={CATEGORY=[AUDIT_EVENT], SEVERITY=[INFORMATIONAL], SERVICE=[ClouderaManager], SERVICE_TYPE=[ManagerServer], USER=[admin], EVENTCODE=[EV_LOGIN_SUCCESS], MESSAGE_CODES=[LOGIN_SUCCESS]}, content=User admin logged in successfully., timestamp=1576569290230} 2019-12-17 13:24:52,250 INFO 1267052060@scm-web-0:com.cloudera.server.web.cmf.AuthenticationFailureEventListener: Authentication failure for user: '' from 172.26.194.114 2019-12-17 13:25:05,877 INFO 1267052060@scm-web-0:com.cloudera.server.web.cmf.AuthenticationSuccessEventListener: Authentication success for user: 'admin' from 172.26.194.114 2019-12-17 13:25:11,032 INFO CMMetricsForwarder-0:com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder: Failed to send metrics. java.lang.reflect.UndeclaredThrowableException at com.sun.proxy.$Proxy122.writeMetrics(Unknown Source) at com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder.sendWithAvro(ClouderaManagerMetricsForwarder.java:325) at com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder.sendMetrics(ClouderaManagerMetricsForwarder.java:312) at com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder.run(ClouderaManagerMetricsForwarder.java:146) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.avro.AvroRemoteException: java.net.ConnectException: Connection refused at org.apache.avro.ipc.specific.SpecificRequestor.invoke(SpecificRequestor.java:88) ... 11 more Caused by: java.net.ConnectException: Connection refused   Do anyone have any idea on that.Please suggest.    Thanks. Devendra   ... View more

Hi,  We are running CDH 5.14.0 version of cloudera.There are multiple warnings coming related to log data directory for only one Data node( hadoop-slave-1). please see warnings.   for the same node,root / dir space is showing critical. can anyone suggest what files i should delete from "/ ,so that i can clear these alarms .   Thanks Devendra     ... View more

Hi, We are using CDH 5.14. Webhdfs is enabled by default on cloudera manger and i am able to list HDFS data through webhdfs protocol.   [root@hadoop-slave-1 ~]# curl -i -L "http://172.16.0.10:50070/webhdfs/v1/?op=LISTSTATUS" HTTP/1.1 200 OK Cache-Control: no-cache Expires: Fri, 27 Sep 2019 13:52:56 GMT Date: Fri, 27 Sep 2019 13:52:56 GMT Pragma: no-cache Expires: Fri, 27 Sep 2019 13:52:56 GMT Date: Fri, 27 Sep 2019 13:52:56 GMT Pragma: no-cache Content-Type: application/json X-FRAME-OPTIONS: SAMEORIGIN Transfer-Encoding: chunked {"FileStatuses":{"FileStatus":[ {"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":33381,"group":"supergroup","length":0,"modificationTime":1569326622576,"owner":"hdfs","pathSuffix":"cli","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}, {"accessTime":0,"blockSize":0,"childrenNum":10,"fileId":17365,"group":"supergroup","length":0,"modificationTime":1569589022824,"owner":"hdfs","pathSuffix":"hadoop","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}, {"accessTime":0,"blockSize":0,"childrenNum":5,"fileId":33483,"group":"supergroup","length":0,"modificationTime":1569331210359,"owner":"hdfs","pathSuffix":"restorefromcli","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}, {"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":33489,"group":"supergroup","length":0,"modificationTime":1569331240068,"owner":"hdfs","pathSuffix":"restorefromcli1","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}, {"accessTime":0,"blockSize":0,"childrenNum":4,"fileId":33645,"group":"supergroup","length":0,"modificationTime":1569331744422,"owner":"hdfs","pathSuffix":"restorefromcli_1","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}, {"accessTime":0,"blockSize":0,"childrenNum":10,"fileId":33346,"group":"supergroup","length":0,"modificationTime":1569589022883,"owner":"hdfs","pathSuffix":"restorehdfs","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}, {"accessTime":0,"blockSize":0,"childrenNum":3,"fileId":16386,"group":"supergroup","length":0,"modificationTime":1568894436274,"owner":"hdfs","pathSuffix":"tmp","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}, {"accessTime":0,"blockSize":0,"childrenNum":5,"fileId":16387,"group":"supergroup","length":0,"modificationTime":1569324647144,"owner":"hdfs","pathSuffix":"user","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}   But i am not able to see any config related to webhdfs in hdfs-site.xml .My concern is that, if this value(dfs.webhdfs.enabled) is enabled in cloudera, then it should also reflect in hdfs-site.xml file.   do anybody have any idea?    Thanks Devendra ... View more