Member since
10-13-2016
31
Posts
4
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2723 | 02-05-2018 03:12 AM | |
4903 | 12-09-2016 08:36 AM | |
1818 | 11-25-2016 07:14 AM | |
3302 | 11-09-2016 09:59 AM | |
3935 | 10-21-2016 10:36 AM |
10-04-2019
12:02 PM
I am having the same error but I didn't understand the solution, can you please explain it. Thank you.
... View more
02-05-2018
03:12 AM
Ok, my bad.
A quotation from stackoverflow:
-libjars makes Jars only available for JVMs running remote map and reduce task
To make these same JAR’s available to the client JVM (The JVM that’s created when you run the hadoop jar command) need to set HADOOP_CLASSPATH environment variable:
Therefore:
export HADOOP_CLASSPATH=`hbase-indexer classpath`:dependencies.jar
I'm using hbase-indexer to get solr dependencies.
Gin
... View more
07-25-2017
07:43 AM
the hbase-indexer morphlines.conf is managed by CM, and will automatically be distributed to each node in the /var/run/cloudera-scm-agent/process directory when hbase-indexer starts. You'll want to specify a relative path name in the morphline-hbase-mapper.xml, and it will pick it up from the process directory: https://www.cloudera.com/documentation/enterprise/latest/topics/search_hbase_batch_indexer.html#concept_q3l_2tb_4r -pd
... View more
03-14-2017
04:49 AM
Spot on, I missed the directory structure and just dumped my jars under plugins.d. The cmd line did not give me clues since it did not have anything related to plugin directories, e.g. "--plugins-path /usr/lib/flume-ng/plugins.d:/var/lib/flume-ng/plugins.d". Thanks!
... View more
12-14-2016
02:18 PM
2 Kudos
Thanks for clarifying, Eric. Although I still think that a separate public/private cloudera-proprietary maven repo would be much more convenient. In the end, these JDBCs end up in (private) maven repos anyway - just takes more hassle. Best, Gin
... View more
11-25-2016
07:14 AM
Apologies, a premature post. Just realised that Solr Core != SolrCloud Core and found out about Collection Aliasing
... View more
11-18-2016
03:00 AM
We are about to perform planned upgrade of the cluster to 5.9 thus the problem will be solved. It is great to know that the issue will become irrelevant. Thanks, Harsh. A fantastic clarification!
... View more
11-09-2016
09:59 AM
1 Kudo
Found the solution! https://groups.google.com/forum/#!searchin/hbase-indexer-user/rowkey%7Csort:relevance/hbase-indexer-user/eitg7QquxRI/MfVA6SXInM8J Post by Wolfgang: You can fetch it (edited: the rowkey) by pasting this code snippet into a “java” morphline command:
org.apache.hadoop.hbase.client.Result result = (org.apache.hadoop.hbase.client.Result) record.getFirstValue("_attachment_body");
byte[] rowKey = result.getRow();
record.put("myRowKey", rowKey);
Possible gotcha: Make sure that this java command appears *before* the extractHBaseCells morphline command in the morphline config file.
http://kitesdk.org/docs/current/morphlines/morphlines-reference-guide.html#java Gin
... View more
10-25-2016
01:12 AM
Fantastic! Thanks, whosch.
... View more