Hello,   I had a problem, my job failed because hbase could not find an existing table.   I then did a:   sudo -u hbase hbase hbck -repair   and now all my tables are gone (beside one)!! I cannot see my old data in the hbase folder! Is there a way to recover all this?   Please help!   Thank you!   ... View more

Hello,   Is there a way to deploy Flume in HA?     Thank you,   ... View more

Hello,   I would like to change my HBase table and add some splits for the keys that don't exists yet.   I tried the folowings without success : split 'table_name', 'key_that_dont_exists_yet' alter 'table_name', {SPLITS=>['my_new_split1','my_new_split2']} However, I have the felling that is not working. When I check the splits, I have the same splits as before in the browser and when I do a hdfs dfs -ls /hbase/data/default/table_name I also have no additional folders...     Note: I'm using CDH 5.3     Thank you!         ... View more

ello,     I would like to set the folowing to true for all my impala queries: set APPX_COUNT_DISTINCT=true;  and I can't find any way to do it...   I need this, because I have some impala queries that I send over the Impala JDBC Driver and that I would like to optimize.   Note: this topic is somehow linked to http://community.cloudera.com/t5/Interactive-Short-cycle-SQL/use-set-command-through-Impala-JDBC-Driver/td-p/37455   Thank you!   Alina     ... View more

Hello,   In CDH 5.6 there is Hive on Spark and Impala. How should we choose between these 2 services? Are there any benchmarks that compare these 2 services?   Thank you! 🙂 ... View more

Hello,   I'm tring to understand the HBase status command meaning. However, I can't find any documentation on this ...     hbase(main):003:0> status 4 servers, 0 dead, 487.2500 average load hbase(main):004:0> status 'replication' 4 servers, 0 dead, 512.0000 average load hbase(main):006:0> status 'summary' 4 servers, 0 dead, 512.0000 average load - is the average load in byte?/kb? - the average is done on each day/ week? - why is the average different than when I do only status and the same on status 'summary' and status 'replication' ?       status 'simple' 4 live servers ip1:60020 1456128551442 requestsPerSecond=0.0, numberOfOnlineRegions=216, usedHeapMB=1963, maxHeapMB=4062, numberOfStores=216, numberOfStorefiles=5321, storefileUncompressedSizeMB=133145, storefileSizeMB=31861, compressionRatio=0,2393, memstoreSizeMB=0, storefileIndexSizeMB=43, readRequestsCount=88432, writeRequestsCount=0, rootIndexSizeKB=64669, totalStaticIndexSizeKB=503682, totalStaticBloomSizeKB=17227, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[] ip2:60020 1456128544596 requestsPerSecond=0.0, numberOfOnlineRegions=631, usedHeapMB=2778, maxHeapMB=4062, numberOfStores=631, numberOfStorefiles=16192, storefileUncompressedSizeMB=293264, storefileSizeMB=75410, compressionRatio=0,2571, memstoreSizeMB=0, storefileIndexSizeMB=92, readRequestsCount=266918, writeRequestsCount=0, rootIndexSizeKB=158970, totalStaticIndexSizeKB=1215591, totalStaticBloomSizeKB=35553, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[] ip3:60020 1456128568835 requestsPerSecond=0.0, numberOfOnlineRegions=489, usedHeapMB=2520, maxHeapMB=4062, numberOfStores=489, numberOfStorefiles=12905, storefileUncompressedSizeMB=279315, storefileSizeMB=69048, compressionRatio=0,2472, memstoreSizeMB=0, storefileIndexSizeMB=91, readRequestsCount=751324, writeRequestsCount=0, rootIndexSizeKB=144189, totalStaticIndexSizeKB=930584, totalStaticBloomSizeKB=26132, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[] ip4:60020 1456128516858 requestsPerSecond=174.0, numberOfOnlineRegions=712, usedHeapMB=2893, maxHeapMB=4062, numberOfStores=712, numberOfStorefiles=17456, storefileUncompressedSizeMB=617248, storefileSizeMB=131324, compressionRatio=0,2128, memstoreSizeMB=1, storefileIndexSizeMB=98, readRequestsCount=22001272, writeRequestsCount=2047, rootIndexSizeKB=167594, totalStaticIndexSizeKB=1776285, totalStaticBloomSizeKB=149625, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[] 0 dead servers Aggregate load: 174, regions: 2048 - what is the meaning of the 'aggregate load' indicator?     status 'detailed'  "test_all,,1453275538489.ed10387c718e4b42573b6720a407b155."             numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=0, writeRequestsCount=0, rootIndexSizeKB=1, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN ... - does the compactionProgressPct correesponds to major_compact ? - What is the meaning of:              totalCompactingKVs              currentCompactedKVs     Thank you!                 ... View more

Hello,   I wanted to folow the slides in order to optimize HBase :http://fr.slideshare.net/lhofhansl/h-base-tuninghbasecon2015ok    However, there are some configurations that I didn't find in Cloudera Manager configurations (in their respective services):   namenode.avoid.read.stale.datanode = true namenode.avoid.write.stale.datanode = true namenode.stale.datanode.interval = 30000 client.read.shortcircuit.buffer.size = 131072 regionserver.checksum.verify = true server.tcpnodelay = true client.tcpnodelay = true hregion.majorcompaction.jitter = 0.5 (½ week, default) hstore.min.locality.to.skip.major.compact master.wait.on.regionservers.timeout ipc.client.tcpnodelay zookeeper.useMulti   Why aren't these available?    Thank you!         ... View more

Hello,   I want to do a script that decides where to move each region. For that I want to use the command:   move ERROR: wrong number of arguments (0 for 1) Here is some help for this command: Move a region. Optionally specify target regionserver else we choose one at random. NOTE: You pass the encoded region name, not the region name so this command is a little different to the others. The encoded region name is the hash suffix on region names: e.g. if the region name were TestTable,0094429456,1289497600452.527db22f95c8a9e0116f0cc13c680396. then the encoded region name portion is 527db22f95c8a9e0116f0cc13c680396 A server name is its host, port plus startcode. For example: host187.example.com,60020,1289493121758 Examples: hbase> move 'ENCODED_REGIONNAME' hbase> move 'ENCODED_REGIONNAME', 'SERVER_NAME'     For that I started to use the   hdfs dfs -du "/hbase/data/default_table_name/" in order to find the region names.      However, I do not know, if there si a shell command to find out the startcode for each region (?).   Thank you!   ... View more

Hello,     I have several HBase tables (each with a bunch of regions), and I do not understand why, but Hbase tends to put all the regions of the same table on the same machine.   However, I already moved the regions in order to have regions from each table on all workers (with the move command), and the day after I saw that the regions were again on either less machines, either on one machine.    I tried to do 'balance_switch false' but with no success (the regions were still moved on one machine..).     I do not want to have them on less machines, because if all the regions are on one machine, then only one machine is working...   Do I get it wrong? Should I let Hbase move the regions on one machine/less machines?     Thank you!       ... View more

Hello,   Impala/ is having better performances on partitioned tables (if they are big enough). However, I use Impala on an external HBase table. My HBase table is partitioned.   Therefore, I wonder if I can match the HBase partitions with the Impala/Hive ones? If yes, How can I do this?     Thank you!   ... View more