Member since
06-07-2016
923
Posts
322
Kudos Received
115
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3351 | 10-18-2017 10:19 PM | |
3713 | 10-18-2017 09:51 PM | |
13420 | 09-21-2017 01:35 PM | |
1386 | 08-04-2017 02:00 PM | |
1846 | 07-31-2017 03:02 PM |
02-27-2017
05:52 PM
@Muhammad Touseef You can use the instructions to stop hadoop services before upgrade. One thing you absolutely want to make sure is no jobs are running. Let any running job complete. The right way to do it would be to stop queues so any running jobs will complete but no new jobs will be submitted. Once all jobs are completed and nothing is running, you can use "stop all" command from Ambari or simply follow the instructions below: https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html ---> check for how to stop queues https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.2.0/bk_upgrading_Ambari/content/_stop_cluster_and_checkpoint_HDFS_mamiu.html -->stop all.
... View more
06-20-2018
04:54 PM
This worked.
... View more
03-02-2017
04:33 PM
Thank you for the explanation @Matt Foley. 🙂
... View more
02-19-2017
02:07 AM
@joseph c actually on a second thought, I realize 15-JAN-14 is also greater than 01-JUN-2011 because 15 is greater than 01 and it is less than 30-JUN-2011 because 15 is less than 30. HBase is behaving exactly how it is supposed to behave. You need to store date in a different format, like YYYYMMDD. When you do that, 20140115 does not fall between 20110601 and 20110630 lexicographically and you will get your expected result. Another way is to convert Date to timestamp.
... View more
02-14-2017
02:13 PM
3 Kudos
3 or whatever number of slave cluster downtime is not really an exceptional case for replication. According to the documents linked below, HBase and Zookeeper will collect a backlog of edits and once the slave cluster is up again, replicate the older edits the same way as newer ones. So in this normal case, best way is to let it do its job. https://hbase.apache.org/0.94/replication.html#Normal_processing https://hbase.apache.org/0.94/replication.html#Non-responding_slave_clusters Abnormal cases can occur if table data gets corrupted and the replication breaks. Then you may have to copy. I don't know about the loads.
... View more
02-07-2017
03:43 PM
It is point in time (time at which distcp runs). It can be automated using scripts. It is replication because you are replicating data. you are confusing replication with real time replication. Replication doesn't have to be real time. And it is impossible because of physics that any change in data in one cluster (or anyother database) will be reflected in the other. I'll give you the example of my HBase use case. We were using Active-Active replication. But even then, we knew that there might be a situation where data will be written to one data center and a power failure will occur as data is being replicated to the remote data center and some data will not be replicated (let's say up to 10 to seconds of data). The only other way to make sure that this does not happen is to "Ack" only when data has been written to the remote data center. This slows down every write and we had 10's of thousands of writes per second. See, you have to make a choice. If you would like to have 100 percent sync then you have to make sure that you ack every single record being written slowing down all your writes. Or you can do asynchronous replication which works 99.99% of the time but in case of network issues between two data centers, you know some data some time will not be replicated right away. There is absolutely nothing technology can do anything here. This is simple Physics.
... View more
02-10-2017
03:39 AM
@Matt Thanks, Matt this is something i was looking at.
... View more
02-09-2017
02:45 PM
Hi , When i type "hbase.regionserver.lease.period" in Ambari configs the following property got invocated "Number of Fetched Rows when Scanning from Disk" It looks we didn't set "hbase.regionserver.lease.period" in our Ambari conifgs. Thanks.
... View more
02-06-2019
05:31 AM
can any one please send me the ambari installation document on ubuntu
... View more
02-09-2017
03:49 PM
Thanks Artem. I tried downloading the VMware image , uploaded to s3 ,created the ami and then spin the cluster from ami.
... View more