hbase.splitlog.manager.timeout 10 min (600000 ms) hbase.splitlog.manager.unassigned.timeout 10 min  (600000 ms) hbase.regionserver.wal.max.splitters 5 to 10 hbase.regionserver.hlog.splitlog.writer.threads 10 this is a workaround not a setting recommended for production system ... View more

How many regions you have per region server? Do you see region transit while you restart service?   Check /hbase/WALs directory (in hdfs) and if you find there are region files followed by .splitting, that is not good. As a work around you can increase the timeout value and number of threads used splitting wals. Alternatives you can delete/move the splitting region wal files and restart hbase. But I don't recommend  this on the production system ... View more

it is related to memory insufficient 2019-08-14T10:25:35.393+0000: 6044.798: [GC (Allocation Failure) 2019-08-14T10:25:35.394+0000: 6044.798: [ParNew: 141353K->5541K(153344K), 0.0276284 secs] 197333K->61739K(3337600K), 0.0278554 secs] [Times: user=0.05 sys=0.00, real=0.03 secs] 2019-08-14T10:25:40.156+0000: 6049.560: [GC (Allocation Failure) 2019-08-14T10:25:40.157+0000: 6049.561: [ParNew: 141861K->4097K(153344K), 0.0249319 secs] 198059K->60298K(3337600K), 0.0264387 secs] [Times: user=0.05 sys=0.00, real=0.03 secs] 2019-08-14T10:27:55.744+0000: 6185.148: [GC (Allocation Failure) 2019-08-14T10:27:55.744+0000: 6185.149: [ParNew: 140417K->5321K(153344K), 0.0315498 secs] 196618K->61535K(3337600K), 0.0317389 secs] [Times: user=0.06 sys=0.00, real=0.03 secs] 2019-08-14T10:29:09.524+0000: 6258.928: [GC (Allocation Failure) 2019-08-14T10:29:09.524+0000: 6258.928: [ParNew: 141641K->6861K(153344K), 0.0333230 secs] 197855K->63260K(3337600K), 0.0334884 secs] [Times: user=0.07 sys=0.00, real=0.04 secs] resolved it by moving the component to another node which has more free memory. ... View more

I have my RS up and running and still facing the same issue. ... View more

SYNCSORT Ironstream is the best option in this case. ... View more

I use freeIPA for the hadoop user auth. It is very easy to do such things in freeIPA. You can refer example-13 of this document https://docs.fedoraproject.org/en-US/Fedora/17/html/FreeIPA_Guide/defining-sudorules.html Example 13.2. Allowing and Denying Commands The sudo rule can grant access or deny access to commands. For example, this rule would allow read access to files but prevent editing: $ ipa sudorule-add-allow-command --sudocmd "/usr/bin/less" readfiles $ ipa sudorule-add-allow-command --sudocmd "/usr/bin/tail" readfiles $ ipa sudorule-add-deny-command --sudocmd "/usr/bin/vim" readfiles ... View more

HDP 2.6.4 to HDP 2.6.5 is a patch/maintenance HDP upgrade. I have recently done with with Ambari 2.6.2 ... View more

for me the old mysql-connector-java.jar was the problem though I had replace it in /use/share/java. as a workaround I have to manually delete the jar as shown in picture and restarted the the hive metastore/all hive services. then service check went through. ... View more

@Sagar Shimpi I have the same issue. It fails for HCAT. How to fix? I have followed the steps mentioned in your comment. ... View more

Make sure you have odd numbers of JN. All the JNs are healthy. ... View more