Member since
04-07-2015
7
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2081 | 09-18-2015 10:13 AM |
09-21-2015
03:39 PM
Thanks Harsh, that was it. It works!
... View more
09-21-2015
10:15 AM
No go yet Harsh, same error again. Here is what I did. $ export HADOOP_CLASSPATH=$(hbase classpath) $ sudo -u hdfs hive Logging initialized using configuration in jar:file:/opt/cloudera/parcels/CDH-5.4.4-1.cdh5.4.4.p0.4/jars/hive-common-1.1.0-cdh5.4.4.jar!/hive-log4j.properties WARNING: Hive CLI is deprecated and migration to Beeline is recommended. hive> ADD JAR /opt/cloudera/parcels/CDH/lib/hbase/lib/metrics-core-2.2.0.jar; Added [/opt/cloudera/parcels/CDH/lib/hbase/lib/metrics-core-2.2.0.jar] to class path Added resources: [/opt/cloudera/parcels/CDH/lib/hbase/lib/metrics-core-2.2.0.jar] hive> SET hive.hbase.snapshot.name=snapshot_20150920; hive> select * from e where id = '...'; OK Failed with exception java.io.IOException:java.io.IOException: java.lang.NoClassDefFoundError: com/yammer/metrics/core/MetricsRegistry Time taken: 28.503 seconds hive> I did verify that $(hbase classpath) has the metrics-core-2.2.0.jar.
... View more
09-20-2015
02:01 PM
Thanks for the reply Harsh. But that did not help. I tried ADD JAR but still getting the same error. Here is what I see from hive shell hive> ADD JAR /opt/cloudera/parcels/CDH/lib/hbase/lib/metrics-core-2.2.0.jar; Added [/opt/cloudera/parcels/CDH/lib/hbase/lib/metrics-core-2.2.0.jar] to class path Added resources: [/opt/cloudera/parcels/CDH/lib/hbase/lib/metrics-core-2.2.0.jar] hive> SET hive.hbase.snapshot.name=snapshot_20150920 > ; hive> select * from e where id = '...'; OK Failed with exception java.io.IOException:java.io.IOException: java.lang.NoClassDefFoundError: com/yammer/metrics/core/MetricsRegistry Time taken: 36.085 seconds hive> I should add that the jar file does exist at the location in ADD JAR $ ls -ltr /opt/cloudera/parcels/CDH/lib/hbase/lib/metrics-core-2.2.0.jar lrwxrwxrwx 1 root root 36 Aug 13 14:40 /opt/cloudera/parcels/CDH/lib/hbase/lib/metrics-core-2.2.0.jar -> ../../../jars/metrics-core-2.2.0.jar
... View more
09-18-2015
10:13 AM
Hrsh, I was able to find the property and I modified queueMaxAppsDefault property and now I get more than 8 apps running concurently. Thanks for your help Nitin
... View more
09-18-2015
08:39 AM
Thanks for the response Harsh. Unfortunately I could not find property queueMaxAMShareDefault any where in CM. We are using CDH 5.4.5. Nitin
... View more
09-16-2015
03:28 PM
Hi, I have observed that for our cluster, running on 7 nodes, with 6 data nodes, at any given point in time no more than 8 apps are running in YARN. When we submit more than 8 apps (MR jobs) concurrently then the apps are in PENDING state. Yarn cluster still has vcores available (idle) and there is free RAM. I could not figure out which configuration setting will enable me to run more apps concurrently in YARN against the default queue, please help. Nitin
... View more
Labels:
- Labels:
-
Apache YARN
08-27-2015
12:18 PM
Hi, we are using CDH5.4.4 and I am trying to use Hive to query HBase snapshots. But when I issue a query I am getting the following exception in the hive CLI Failed with exception java.io.IOException:java.io.IOException: java.lang.NoClassDefFoundError: com/yammer/metrics/core/MetricsRegistry Here are the steps I took 1. Created an HBase snapshot 'snapshot_20150827' 2. In Hive CLI executed the following a. Create external table CREATE EXTERNAL TABLE e(id STRING,.....) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,....") TBLPROPERTIES ("hbase.table.name" = "e", "hbase.table.default.storage.type" = "binary") b. SET hive.hbase.snapshot.name=snapshot_20150827; c. Execute the query select * from e where id = '...'; and this gives me the exception noted above, please help. Nitin
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache HBase
-
Apache Hive