Member since
05-30-2018
1322
Posts
715
Kudos Received
148
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4032 | 08-20-2018 08:26 PM | |
| 1933 | 08-15-2018 01:59 PM | |
| 2365 | 08-13-2018 02:20 PM | |
| 4094 | 07-23-2018 04:37 PM | |
| 5002 | 07-19-2018 12:52 PM |
05-24-2016
03:51 PM
1 Kudo
@Constantin Stanca This is standard for hbase development. If you can't see what your JVM is doing your driving blind. tuning the flushes for the memstore and blockcache are vital for performance. Testing GC for G1 vs CMS on namenode or hbase is vital for performance. For production remote access yes you always need clearance. Monitoring JVM during development is highly useful for namenode and hbase.
... View more
05-23-2016
03:11 PM
HBASE-10201 enabled logic to flush based on size of CF. If the size of CF > DEFAULT_HREGION_MEMSTORE_PER_COLUMN_FAMILY_FLUSH then it will flush those CFs and not entire memstore. How to enable this? I don't see much documentation on this feature.
... View more
Labels:
- Labels:
-
Apache HBase
05-23-2016
03:09 PM
@Enis The core of opening this post was regarding HBASE_10201. This features allows to flushes based on column family size. If the CF > DEFAULT_HREGION_MEMSTORE_PER_COLUMN_FAMILY_FLUSH the it will flush does families. Your thoughts?
... View more
05-21-2016
02:53 AM
1 Kudo
I want to set a hive variable which will be used by all hive sessions. Any ideas how I can do this?
... View more
Labels:
- Labels:
-
Apache Hive
05-21-2016
01:34 AM
12 Kudos
The goal of this article is to provide you step by step instruction to install jVisualVM to monitor JVMs inside your hadoop environment. Consult your operations team prior to making any production changes Go here to download jVisualVM - tool to visually monitor JVM in hadoop. HBase is a great example where you want to visually analyze JVM health. You may already have this tool on your workstation. Simple go to command line and type jVisualVM. If it comes up your in business. else download it: Once you have application up and running install the Visual GC plugin. Tools ->available plugins->Visual GC Lets go to the node you want to monitor. For jVisualVM to work it needs jstatd to run on the node. Once jstatd is running it automatically sends updates of remote applications running on the node to jVisualVM. Run jstatd from command line. If you get the following error: We need to perform an additional simple configuration. Do the following steps Run which jstatd then cd into the bin location Create a policy file jstatd.all.policy in the bin directory (same location as jstatd). We are building a policy to allow jstatd to have permission to everything. Inside the file add the following: grant codebase "file:${java.home}/../lib/tools.jar" { permission java.security.AllPermission; }; Now run following command to start jstatd with your policy: ./jstatd -J-Djava.security.policy=jstatd.all.policy & End of steps for jstatd error Test if jstatd is running by issuing this command: jps -l -m -v rmi://localhost You will see tons of output such as: Which looks good Open jvisualVM (command line type jVisualVM) Right click on remote and select add remote host Add hostname or IP address of node you want to analyze: Now you are connected. Click on arrow next to your remote. This will display all JVMs running on the node: Now you can start analyzing. lets click on hbase data node and click on monitor tab: Click on Visual GC tab to analyze different generations inside the JVM. I hope this article helps you start analyzing at a deeper level JVMs on hadoop especially with hbase.
... View more
Labels:
05-20-2016
09:03 PM
@Ted Yu My mind drew a black about defaults. HBase will use default value unless you specifcy in ambari custom hbase site. thanks
... View more
05-20-2016
07:43 PM
I am testing minor compaction performance and noticed the configration hbase.hstore.compaction.ratio is not available on the sandbox within hbase-site.xml. How come?
... View more
Labels:
- Labels:
-
Apache HBase
05-20-2016
04:41 AM
@ssoldatov Just similar RDBMS ddl trigger statement: CREATE [ OR REPLACE ] TRIGGER trigger_name
BEFORE INSERT
ON table_name
[ FOR EACH ROW ]
DECLARE
-- variable declarations
BEGIN
-- trigger code
EXCEPTION
WHEN ...
-- exception handling
END; However the semantics would be for hbase coprocessor. For example the trigger or coprocessing i want to do pre or post PUT.
... View more
05-20-2016
04:11 AM
Can phoenix create or call endpoint coprocessors? I imagine this would look extremely similar to create stored procedure ddl statement. if this doesn't exist maybe I should change to idea.
... View more
Labels:
- Labels:
-
Apache Phoenix
05-20-2016
04:03 AM
Like hbase coprocessors does phoenix have the ability to create one which would essentially look like a sql create trigger statement. Maybe I should change this to idea if it doesn't exist.
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache Phoenix