Member since
08-23-2017
5
Posts
0
Kudos Received
0
Solutions
10-10-2017
04:57 AM
Hello, I'm trying to set a name for indexing jobs launched with cmd_hdp=$(
HADOOP_OPTS="-Djava.security.auth.login.config=jaas.conf" hadoop --config /etc/hadoop/conf.cloudera.yarn \
jar /opt/cloudera/parcels/CDH/lib/solr/contrib/mr/search-mr-*-job.jar \
org.apache.solr.hadoop.MapReduceIndexerTool \
-D morphlineVariable.ZK_HOST=myZKHost:2181/solr \
-D morphlineVariable.COLLECTION=myCollection \
-D mapreduce.map.memory.mb=8192 \
-D mapred.child.java.opts=-Xmx4096m \
-D mapreduce.reduce.java.opts=-Xmx4096m \
-D mapreduce.reduce.memory.mb=8192 \
--output-dir hdfs://myHdfsHost:8020/tmp/my/data \
--morphline-file morphlines/myMorphline.conf \
--log4j log4j.properties \
--go-live \
--collection myCollection \
--zk-host myZKHost:2181/solr \
hdfs://myHdfsHost:8020/my/data/
) Actual name is "org.apache.solr.hadoop.MapReduceIndexerTool/MorphlineMapper" but I'd like to change it. I already tried setting -D mapreduce.job.name=myName but it does not change.
... View more
Labels:
- Labels:
-
Apache Solr
-
MapReduce