Member since
02-28-2022
4
Posts
0
Kudos Received
0
Solutions
05-09-2022
06:21 AM
Similar to this, I have a use case to compare Ansible Code with the Ambari Configs. The reason we are doing this is that we found several inconsistencies w.r.t to Ansible code and Ambari configs. But comparing both is a big task as there are many playbooks where we have Hadoop code so checking all the code base a heck. Any other option to do the comparison.....
... View more
04-28-2022
10:04 AM
There is no direct method or property to disable tombstone marker. Major compacting the mob CF is the only way to go. There is a mob cleaner running on master that removes unreferenced mob files: The period of the cleaner chore can be configured by setting hbase.master.mob.cleaner.period to a positive integer number of seconds. It defaults to running daily. You should not need to tune it unless you have a very aggressive TTL or a very high rate of MOB updates with a correspondingly high rate of non-MOB compactions. So you can check and set the above parameter value and can manually trigger mob compaction by specifying the cf that includes mob data in hbase shell. NOTE : MOBs are mostly for writing large cells that will rarely be updated or deleted but could have TTL configured for the cell or CF.
... View more
04-19-2022
09:39 AM
I recently face this same issue on one of our environment. Error: returned 1. ERROR: Cannot set priority of zkfc process 24167 When digged more on the ZKFC Log, I found this error: ERROR org.apache.hadoop.ha.ZKFailoverController: Unable to start failover controller. Parent znode does not exist. I applied the solution to format ZKFC and once done I have restarted the services and it worked fine. bin/hdfs zkfc -formatZK
... View more