I am using CDH 5.16.1 and I hit the issue HDFS-8298 as discussed in the below link   https://issues.apache.org/jira/browse/HDFS-8298   Can someone let me know if this is yet fixed in any of the CDH versions?     ... View more

Cross-posting from stackoverflow :-   Can someone let me know how can we upgrade an unmanaged CDH Cluster from 5.16 to 6.1?   I am not able to locate any docs to upgrade unmanaged cluster (running 5.16) via command line like the one below for 5.15   https://www.cloudera.com/documentation/enterprise/5-15-x/topics/cdh_ig_upgrade_command_line.html   Can someone point me to the corresponding doc for 6.1?     ... View more

Is zookeeper client in CDH 5.15 follows the same backward compatibility principle as mentioned in the below link?   https://cwiki.apache.org/confluence/display/ZOOKEEPER/ReleaseManagement     ... View more

CDH 15 is released as mentioned in the below link http://community.cloudera.com/t5/Community-News-Release/ANNOUNCE-Cloudera-Enterprise-5-15-is-Now-Available/m-p/69154#M233   But in the maven central repo I am not able to see any hbase-client specific to CDH 15. The latest available is 5.14.2.   https://mvnrepository.com/artifact/org.apache.hbase/hbase-client?repo=cloudera   Are we supposed to use 5.14.2 clients with CDH 15 ? I could not find anything related to this in documentation. ... View more

I am trying to use `HBaseTestingUtility` as mentioned in the cloudera blog with `hbase-shaded-client` & `hbase-shaded-sever`. But whenever I am starting the mini cluster it is throwing the below exeception   java.lang.ClassCastException: org.apache.hadoop.hbase.shaded.org.mortbay.jetty.servlet.Context$SContext cannot be cast to org.mortbay.jetty.handler.ContextHandler$SContext at org.mortbay.jetty.servlet.DefaultServlet.init(DefaultServlet.java:154) at javax.servlet.GenericServlet.init(GenericServlet.java:241) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:440) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.servlet.ServletHolder.doStart(ServletHolder.java:263) at org.apache.hadoop.hbase.shaded.org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:736) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.servlet.Context.startContext(Context.java:140) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:519) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) at org.apache.hadoop.hbase.shaded.org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156) at org.apache.hadoop.hbase.shaded.org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130) at org.apache.hadoop.hbase.shaded.org.mortbay.jetty.Server.doStart(Server.java:224) at org.apache.hadoop.hbase.shaded.org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:900) at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142) at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:774) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:667) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:838) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:817) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1538) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1114) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:985) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:814) at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:745) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:585) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:987) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:868) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:862) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:806) at com.vnera.storage.metrics.HBaseTestTableFactory.<init>(HBaseTestTableFactory.java:25) at com.vnera.storage.metrics.HBaseTests.testCounterTimetamp(HBaseTests.java:70) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47) at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242) at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)   Versions hbase-shaded-client - 1.2.0-cdh5.7.2.1 hbase-shaded-server - 1.2.0-cdh5.7.2.1 hbase-testing-util - 1.2.0-cdh5.7.2.1 Looks like some bug with `hbase-testing-util` when running with `hbase-shaded-client` & `hbase-shaded-server`.   Is there any workaround for this or when is this expected to be fixed? ... View more

Cross-posting from stackoverflow   I am trying to use  HBaseTestingUtility  with CDH 5.7 as mentioned in the below blog and github   http://blog.cloudera.com/blog/2013/09/how-to-test-hbase-applications-using-popular-tools/ https://github.com/sitaula/HBaseTest I have modified my   pom.xml   for CDH 5.7 like below   < project xmlns = "http://maven.apache.org/POM/4.0.0" xmlns : xsi = "http://www.w3.org/2001/XMLSchema-instance" xsi : schemaLocation = "http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd" > < modelVersion > 4.0 . 0 </ modelVersion > < groupId > HBaseTest </ groupId > < artifactId > Test </ artifactId > < version > 0.0 . 1 - SNAPSHOT </ version > < name > Test Project </ name > < repositories > < repository > < id > cloudera </ id > < url > https : //repository.cloudera.com/artifactory/cloudera-repos/</url> </ repository > </ repositories > < properties > < hadoop . version > 2.6 . 0 - cdh5 . 7.1 </ hadoop . version > < hbase . version > 1.2 . 0 - cdh5 . 7.0 </ hbase . version > </ properties > < dependencies > < dependency > < groupId > org . apache . hadoop </ groupId > < artifactId > hadoop - core </ artifactId > < version > 2.6 . 0 - mr1 - cdh5 . 7.0 . 2 </ version > </ dependency > < dependency > < groupId > org . apache . hbase </ groupId > < artifactId > hbase </ artifactId > < version > $ { hbase . version }</ version > < scope > compile </ scope > </ dependency > < dependency > < groupId > junit </ groupId > < artifactId > junit </ artifactId > < version > 4.11 </ version > < scope > test </ scope > </ dependency > < dependency > < groupId > org . apache . hadoop </ groupId > < artifactId > hadoop - common </ artifactId > < version > $ { hadoop . version }</ version > < scope > compile </ scope > </ dependency > < dependency > < groupId > org . mockito </ groupId > < artifactId > mockito - all </ artifactId > < version > 1.9 . 5 </ version > </ dependency > < dependency > < groupId > org . apache . mrunit </ groupId > < artifactId > mrunit </ artifactId > < version > 0.9 . 0 - incubating </ version > < classifier > hadoop2 </ classifier > </ dependency > < dependency > < groupId > org . apache . hadoop </ groupId > < artifactId > hadoop - common </ artifactId > < version > $ { hadoop . version }</ version > < type > test - jar </ type > < scope > test </ scope > </ dependency > < dependency > < groupId > org . apache . hbase </ groupId > < artifactId > hbase </ artifactId > < version > $ { hbase . version }</ version > < type > test - jar </ type > < scope > test </ scope > </ dependency > < dependency > < groupId > org . apache . hadoop </ groupId > < artifactId > hadoop - hdfs </ artifactId > < version > $ { hadoop . version }</ version > < type > test - jar </ type > < scope > test </ scope > </ dependency > < dependency > < groupId > org . apache . hadoop </ groupId > < artifactId > hadoop - hdfs </ artifactId > < version > $ { hadoop . version }</ version > < scope > test </ scope > </ dependency > </ dependencies > </ project > But on trying to do   mvn clean install   it is failing with the below error [ ERROR ] Failed to execute goal on project Test : Could not resolve dependencies for project HBaseTest : Test : jar : 0.0 . 1 - SNAPSHOT : The following artifacts could not be resolved : org . apache . hbase : hbase : jar : 1.2 . 0 - cdh5 . 7.0 , org . apache . hbase : hbase : jar : tests : 1.2 . 0 - cdh5 . 7.0 : Failure to find org . apache . hbase : hbase : jar : 1.2 . 0 - cdh5 . 7.0 Can someone let me know what is going wrong? ... View more

Is `hadoop-yarn-api` backward compatible? I can find this blog post which talks about `hbase-client` api. Does the same thiing old for `hadoop-yarn-api` as well for `2.6.0-cdh5.13.0` and `2.6.0-cdh5.7.0` ?     < dependency > < groupId > org.apache.hadoop </ groupId > < artifactId > hadoop-yarn-api </ artifactId > < version >2.6.0-cdh5.13.0 </ version > </ dependency >       ... View more

In HDFS rolling upgrade   page   at a high level I am seeing the steps mentioned like below   hdfs dfsadmin -rollingUpgrade prepare Upgrade standby NN2 and start NN2 with   hdfs dfsadmin -rollingUpgrade started Shutdown, upgrade NN1 and start NN1 with   hdfs dfsadmin -rollingUpgrade started But in cloudera   documentation   of Hadoop to prepare the cluster for upgrade it is just saying to enter NN in safemode & save namespace sudo -u hdfs hdfs dfsadmin -safemode enter sudo -u hdfs hdfs dfsadmin -saveNamespace Can some one let me know why there is a difference in the above steps? Is it just sufficient to enter in   -safemode   before doing the upgrade? If yes what does   -rollingUpgrade started   do then? In the cloudera documentation I am not seeing anything about   -safemode leave. When it will leave the   safemode? Will it auto leave the   safemode   ? ... View more

Crossposting from stackoverflow   Can someone let me know how can I perform Rolling Upgrade of CDH from 5.7 to 5.13? I could not find much in Cloudera documentation regarding rolling upgrade of CDH Community Edition without Cloudera Enterprise Manager? ... View more