question Re: Is there any way to find out how much time is taken for Major Compaction of a specific table? in Archives of Support Questions (Read Only)

Is there any way to find out how much time is taken for Major Compaction of a specific table?

KuldeepK — Wed, 25 Nov 2015 19:47:32 GMT

We can find it from regionserver logs but I want to know if there is any other better way.

Re: Is there any way to find out how much time is taken for Major Compaction of a specific table?

nsabharwal — Thu, 26 Nov 2015 04:34:44 GMT

@Kuldeep Kulkarni

Couple of links

http://www.lilyproject.org/lily/index.html and this blog explains it nicely

Also, you can leverage JMX to expose the metrics.

Re: Is there any way to find out how much time is taken for Major Compaction of a specific table?

KuldeepK — Thu, 26 Nov 2015 12:47:02 GMT

Thank you @Neeraj Sabharwal

Re: Is there any way to find out how much time is taken for Major Compaction of a specific table?

KuldeepK — Thu, 26 Nov 2015 21:09:49 GMT

@Neeraj Sabharwal - We can also use this tool to monitor compactions

https://github.com/sentric/hannibal/blob/master/README.markdown

Re: Is there any way to find out how much time is taken for Major Compaction of a specific table?

nsabharwal — Thu, 26 Nov 2015 21:10:57 GMT

@Kuldeep Kulkarni Thanks! I did see it ...Looks good. I will test this in my env.

Re: Is there any way to find out how much time is taken for Major Compaction of a specific table?

KuldeepK — Thu, 26 Nov 2015 21:12:34 GMT

@Neeraj Sabharwal - Sure! I'm currently testing it on my local setup, will update you with the results!

Re: Is there any way to find out how much time is taken for Major Compaction of a specific table?

nsabharwal — Thu, 26 Nov 2015 21:13:35 GMT

@Kuldeep Kulkarni Please upload screenshots when you done. Thanks again 🙂

Ready to test it now.

Re: Is there any way to find out how much time is taken for Major Compaction of a specific table?

nsabharwal — Thu, 26 Nov 2015 21:25:44 GMT

I am on HDP 2.3.2 ..I will troubleshoot this soon @Kuldeep Kulkarni

[root@phdns01 hannibal]# sh -x start

Exception in thread "main" java.lang.NoClassDefFoundError: play.core.server.NettyServer

at gnu.java.lang.MainThread.run(libgcj.so.10)

Caused by: java.lang.ClassNotFoundException: play.core.server.NettyServer not found in gnu.gcj.runtime.SystemClassLoader{urls=[file:./conf/,file:/usr/hdp/2.3.4.0-

Re: Is there any way to find out how much time is taken for Major Compaction of a specific table?

nsabharwal — Thu, 26 Nov 2015 21:28:28 GMT

@Kuldeep Kulkarni

looks like not ready with HBase 1.x

[root@phdns01 hannibal-v.0.10.1]# ./build

building Hannibal for HBase 0.90 (may be altered by assigning 0.90, 0.92, 0.94, 0.96 or 0.98 to HANNIBAL_HBASE_VERSION)

java.lang.NoSuchMethodError: method java.util.regex.Matcher.quoteReplacement with signature (Ljava.lang.String;)Ljava.lang.String; was not found.

Re: Is there any way to find out how much time is taken for Major Compaction of a specific table?

KuldeepK — Thu, 26 Nov 2015 23:47:12 GMT

@Neeraj Sabharwal Yeah correct! for me build got completed successfully but unable to get UI, looks like version issue, will test on 0.90 and see