Cloudera Community

Welcome to the Cloudera Community

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

Problems runnig Lily Hbase on a real cluster comming from the Vm

avatar
author-rank gboyreau
New Contributor

Created ‎12-23-2014 08:16 AM

Hi,

 

I have some troubles runnig he tutorial from Cloudera (http://www.cloudera.com/content/cloudera/en/documentation/cloudera-search/v1-latest/Cloudera-Search-...

 

Following these stesps on the Cloudera VM works fine. But then, deploying on a real cluster (4 data nodes, 3 zookeeper nodes, ...), the first part of the map-reduce go away with stranges filepath.

 

4/12/23 17:06:48 INFO hadoop.ForkedZooKeeperInspector: Load collection config from:/collections/test
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/admin-extra.menu-top.html
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/currency.xml
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/protwords.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/mapping-FoldToASCII.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/solrconfig.xml
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/contractions_ga.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_hi.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_eu.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_sv.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_es.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/contractions_it.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/userdict_ja.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stoptags_ja.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stemdict_nl.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_bg.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_hy.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_el.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/hyphenations_ga.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_ar.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_fr.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_pt.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_nl.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_th.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_de.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_lv.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/contractions_ca.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_ru.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_ca.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_da.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_gl.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_no.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_tr.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_fa.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_hu.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_id.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_ro.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_cz.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_ja.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_fi.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_it.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/contractions_fr.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_ga.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/lang/stopwords_en.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/stopwords.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/spellings.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/mapping-ISOLatin1Accent.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/admin-extra.html
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/xslt/luke.xsl
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/xslt/updateXml.xsl
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/xslt/example_atom.xsl
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/xslt/example.xsl
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/xslt/example_rss.xsl
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/synonyms.txt
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/scripts.conf
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/update-script.js
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/elevate.xml
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/admin-extra.menu-bottom.html
14/12/23 17:06:49 INFO cloud.ZkController: Write file /tmp/1419350808997-0/schema.xml
14/12/23 17:06:49 INFO zookeeper.ZooKeeper: Session: 0x14a7243fd6f0955 closed
14/12/23 17:06:49 INFO hadoop.ForkedMapReduceIndexerTool: Indexing data into 1 reducers
14/12/23 17:06:49 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
14/12/23 17:06:49 INFO zookeeper.ClientCnxn: EventThread shut down
14/12/23 17:06:50 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x6eaaf5a4 connecting to ZooKeeper ensemble=cuxnn02.maafprod.e-corail.com:2181,cuxsn01.maafprod.e-corail.com:2181,cuxnn01.maafprod.e-corail.com:2181
14/12/23 17:06:50 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=cuxnn02.maafprod.e-corail.com:2181,cuxsn01.maafprod.e-corail.com:2181,cuxnn01.maafprod.e-corail.com:2181 sessionTimeout=60000 watcher=hconnection-0x6eaaf5a4, quorum=cuxnn02.maafprod.e-corail.com:2181,cuxsn01.maafprod.e-corail.com:2181,cuxnn01.maafprod.e-corail.com:2181, baseZNode=/hbase
14/12/23 17:06:50 INFO zookeeper.ClientCnxn: Opening socket connection to server cuxnn01.maafprod.e-corail.com/10.231.0.203:2181. Will not attempt to authenticate using SASL (unknown error)
14/12/23 17:06:50 INFO zookeeper.ClientCnxn: Socket connection established to cuxnn01.maafprod.e-corail.com/10.231.0.203:2181, initiating session
14/12/23 17:06:50 INFO zookeeper.ClientCnxn: Session establishment complete on server cuxnn01.maafprod.e-corail.com/10.231.0.203:2181, sessionid = 0x34a7243f117096b, negotiated timeout = 60000
14/12/23 17:06:50 INFO util.RegionSizeCalculator: Calculating region sizes for table "record".
14/12/23 17:06:50 INFO client.HConnectionManager$HConnectionImplementation: Closing master protocol: MasterService
14/12/23 17:06:50 INFO client.HConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x34a7243f117096b
14/12/23 17:06:50 INFO zookeeper.ZooKeeper: Session: 0x34a7243f117096b closed
14/12/23 17:06:50 INFO zookeeper.ClientCnxn: EventThread shut down
14/12/23 17:06:50 INFO mapreduce.JobSubmitter: number of splits:1
14/12/23 17:06:50 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local37273687_0001
14/12/23 17:06:50 WARN conf.Configuration: file:/tmp/hadoop-potv360/mapred/staging/potv36037273687/.staging/job_local37273687_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
14/12/23 17:06:50 WARN conf.Configuration: file:/tmp/hadoop-potv360/mapred/staging/potv36037273687/.staging/job_local37273687_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip <- /home/potv360/creation_solr_perimetre_1/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Localized file:/tmp/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip as file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-potv360/mapred/local/1419350810897/guava-11.0.2.jar <- /home/potv360/creation_solr_perimetre_1/guava-11.0.2.jar
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Localized file:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/jars/guava-11.0.2.jar as file:/tmp/hadoop-potv360/mapred/local/1419350810897/guava-11.0.2.jar
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-potv360/mapred/local/1419350810898/hbase-server-0.98.6-cdh5.2.0.jar <- /home/potv360/creation_solr_perimetre_1/hbase-server-0.98.6-cdh5.2.0.jar
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Localized file:/tmp/hadoop-potv360/hadoop-unjar4550147711394879312/lib/hbase-server-0.98.6-cdh5.2.0.jar as file:/tmp/hadoop-potv360/mapred/local/1419350810898/hbase-server-0.98.6-cdh5.2.0.jar
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-potv360/mapred/local/1419350810899/hbase-client-0.98.6-cdh5.2.0.jar <- /home/potv360/creation_solr_perimetre_1/hbase-client-0.98.6-cdh5.2.0.jar
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Localized file:/tmp/hadoop-potv360/hadoop-unjar4550147711394879312/lib/hbase-client-0.98.6-cdh5.2.0.jar as file:/tmp/hadoop-potv360/mapred/local/1419350810899/hbase-client-0.98.6-cdh5.2.0.jar
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-potv360/mapred/local/1419350810900/zookeeper-3.4.5-cdh5.2.0.jar <- /home/potv360/creation_solr_perimetre_1/zookeeper-3.4.5-cdh5.2.0.jar
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Localized file:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/jars/zookeeper-3.4.5-cdh5.2.0.jar as file:/tmp/hadoop-potv360/mapred/local/1419350810900/zookeeper-3.4.5-cdh5.2.0.jar
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Creating symlink: /tmp/hadoop-potv360/mapred/local/1419350810901/netty-3.6.2.Final.jar <- /home/potv360/creation_solr_perimetre_1/netty-3.6.2.Final.jar
14/12/23 17:06:51 INFO mapred.LocalDistributedCacheManager: Localized file:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/jars/netty-3.6.2.Final.jar as file:/tmp/hadoop-potv360/mapred/local/1419350810901/netty-3.6.2.Final.jar
...
14/12/23 17:06:51 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
14/12/23 17:06:51 INFO mapred.LocalJobRunner: OutputCommitter set in config null
14/12/23 17:06:51 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
14/12/23 17:06:51 INFO mapred.LocalJobRunner: Waiting for map tasks
14/12/23 17:06:51 INFO mapred.LocalJobRunner: Starting task: attempt_local37273687_0001_m_000000_0
14/12/23 17:06:51 INFO mapred.Task:  Using ResourceCalculatorProcessTree : [ ]
14/12/23 17:06:51 INFO mapred.MapTask: Processing split: cuxdn02.maafprod.e-corail.com:,
14/12/23 17:06:51 INFO mapreduce.MultiTableInputFormatBase: Input split length: 0 bytes.
14/12/23 17:06:51 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x181ce810 connecting to ZooKeeper ensemble=cuxnn02.maafprod.e-corail.com:2181,cuxsn01.maafprod.e-corail.com:2181,cuxnn01.maafprod.e-corail.com:2181
14/12/23 17:06:51 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=cuxnn02.maafprod.e-corail.com:2181,cuxsn01.maafprod.e-corail.com:2181,cuxnn01.maafprod.e-corail.com:2181 sessionTimeout=60000 watcher=hconnection-0x181ce810, quorum=cuxnn02.maafprod.e-corail.com:2181,cuxsn01.maafprod.e-corail.com:2181,cuxnn01.maafprod.e-corail.com:2181, baseZNode=/hbase
14/12/23 17:06:51 INFO zookeeper.ClientCnxn: Opening socket connection to server cuxsn01.maafprod.e-corail.com/10.231.0.207:2181. Will not attempt to authenticate using SASL (unknown error)
14/12/23 17:06:51 INFO zookeeper.ClientCnxn: Socket connection established to cuxsn01.maafprod.e-corail.com/10.231.0.207:2181, initiating session
14/12/23 17:06:51 INFO zookeeper.ClientCnxn: Session establishment complete on server cuxsn01.maafprod.e-corail.com/10.231.0.207:2181, sessionid = 0x14a7243fd6f0957, negotiated timeout = 60000
14/12/23 17:06:51 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)
14/12/23 17:06:51 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100
14/12/23 17:06:51 INFO mapred.MapTask: soft limit at 83886080
14/12/23 17:06:51 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600
14/12/23 17:06:51 INFO mapred.MapTask: kvstart = 26214396; length = 6553600
14/12/23 17:06:51 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/12/23 17:06:51 WARN mr.HBaseIndexerMapper: Changing row read mode from DYNAMIC to NEVER
14/12/23 17:06:51 INFO mapred.LocalJobRunner: 
14/12/23 17:06:51 INFO client.HConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x14a7243fd6f0957
14/12/23 17:06:51 INFO zookeeper.ZooKeeper: Session: 0x14a7243fd6f0957 closed
14/12/23 17:06:51 INFO zookeeper.ClientCnxn: EventThread shut down
14/12/23 17:06:51 INFO mapred.MapTask: Starting flush of map output
14/12/23 17:06:51 INFO mapred.Task: Task:attempt_local37273687_0001_m_000000_0 is done. And is in the process of committing
14/12/23 17:06:51 INFO mapred.LocalJobRunner: map
14/12/23 17:06:51 INFO mapred.Task: Task 'attempt_local37273687_0001_m_000000_0' done.
14/12/23 17:06:51 INFO mapred.LocalJobRunner: Finishing task: attempt_local37273687_0001_m_000000_0
14/12/23 17:06:51 INFO mapred.LocalJobRunner: map task executor complete.
14/12/23 17:06:51 INFO mapred.LocalJobRunner: Waiting for reduce tasks
14/12/23 17:06:51 INFO mapred.LocalJobRunner: Starting task: attempt_local37273687_0001_r_000000_0
14/12/23 17:06:51 INFO mapred.Task:  Using ResourceCalculatorProcessTree : [ ]
14/12/23 17:06:51 INFO mapred.ReduceTask: Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@28e2e252
14/12/23 17:06:51 INFO reduce.MergeManagerImpl: MergerManager: memoryLimit=652528832, maxSingleShuffleLimit=163132208, mergeThreshold=430669056, ioSortFactor=10, memToMemMergeOutputsThreshold=10
14/12/23 17:06:51 INFO reduce.EventFetcher: attempt_local37273687_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
14/12/23 17:06:51 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local37273687_0001_m_000000_0 decomp: 2 len: 6 to MEMORY
14/12/23 17:06:51 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local37273687_0001_m_000000_0
14/12/23 17:06:51 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->2
14/12/23 17:06:51 INFO reduce.EventFetcher: EventFetcher is interrupted.. Returning
14/12/23 17:06:51 INFO mapred.LocalJobRunner: 1 / 1 copied.
14/12/23 17:06:51 INFO reduce.MergeManagerImpl: finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs
14/12/23 17:06:51 INFO mapred.Merger: Merging 1 sorted segments
14/12/23 17:06:51 INFO mapred.Merger: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
14/12/23 17:06:51 INFO reduce.MergeManagerImpl: Merged 1 segments, 2 bytes to disk to satisfy reduce memory limit
14/12/23 17:06:51 INFO reduce.MergeManagerImpl: Merging 1 files, 6 bytes from disk
14/12/23 17:06:51 INFO reduce.MergeManagerImpl: Merging 0 segments, 0 bytes from memory into reduce
14/12/23 17:06:51 INFO mapred.Merger: Merging 1 sorted segments
14/12/23 17:06:51 INFO mapred.Merger: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
14/12/23 17:06:51 INFO mapred.LocalJobRunner: 1 / 1 copied.
14/12/23 17:06:51 INFO hadoop.HeartBeater: Heart beat reporting class is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
14/12/23 17:06:51 INFO hadoop.SolrRecordWriter: Using this unpacked directory as solr home: file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip
14/12/23 17:06:51 INFO hadoop.SolrRecordWriter: Creating embedded Solr server with solrHomeDir: file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip, fs: org.apache.hadoop.fs.LocalFileSystem@13c9319b, outputShardDir: file:/tmp/search-091771a0-2e8c-4aab-8c70-0f6c07763ee4/reducers/_temporary/0/_temporary/attempt_local37273687_0001_r_000000_0/part-r-00000
14/12/23 17:06:51 INFO hadoop.HeartBeater: HeartBeat thread running
14/12/23 17:06:51 INFO hadoop.HeartBeater: Issuing heart beat for 1 threads
14/12/23 17:06:52 INFO core.SolrResourceLoader: new SolrResourceLoader for directory: 'file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip/'
14/12/23 17:06:52 INFO hadoop.SolrRecordWriter: Constructed instance information solr.home file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip (file:///tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip), instance dir file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip/, conf dir file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip/conf/, writing index to solr.data.dir file:/tmp/search-091771a0-2e8c-4aab-8c70-0f6c07763ee4/reducers/_temporary/0/_temporary/attempt_local37273687_0001_r_000000_0/part-r-00000/data, with permdir file:/tmp/search-091771a0-2e8c-4aab-8c70-0f6c07763ee4/reducers/_temporary/0/_temporary/attempt_local37273687_0001_r_000000_0/part-r-00000
14/12/23 17:06:52 INFO core.ConfigSolr: Loading container configuration from /home/potv360/creation_solr_perimetre_1/file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip/solr.xml
14/12/23 17:06:52 INFO core.ConfigSolr: /home/potv360/creation_solr_perimetre_1/file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip/solr.xml does not exist, using default configuration
14/12/23 17:06:52 INFO core.CoreContainer: New CoreContainer 418731647
14/12/23 17:06:52 INFO core.CoreContainer: Loading cores into CoreContainer [instanceDir=file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip/]
14/12/23 17:06:52 INFO component.HttpShardHandlerFactory: Setting socketTimeout to: 0
14/12/23 17:06:52 INFO component.HttpShardHandlerFactory: Setting urlScheme to: http://
14/12/23 17:06:52 INFO component.HttpShardHandlerFactory: Setting connTimeout to: 0
14/12/23 17:06:52 INFO component.HttpShardHandlerFactory: Setting maxConnectionsPerHost to: 20
14/12/23 17:06:52 INFO component.HttpShardHandlerFactory: Setting corePoolSize to: 0
14/12/23 17:06:52 INFO component.HttpShardHandlerFactory: Setting maximumPoolSize to: 2147483647
14/12/23 17:06:52 INFO component.HttpShardHandlerFactory: Setting maxThreadIdleTime to: 5
14/12/23 17:06:52 INFO component.HttpShardHandlerFactory: Setting sizeOfQueue to: -1
14/12/23 17:06:52 INFO component.HttpShardHandlerFactory: Setting fairnessPolicy to: false
14/12/23 17:06:52 INFO impl.HttpClientUtil: Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
14/12/23 17:06:52 INFO logging.LogWatcher: Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
14/12/23 17:06:52 INFO core.CoreContainer: Creating SolrCore 'collection1' using instanceDir: file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip/collection1
14/12/23 17:06:52 INFO core.SolrResourceLoader: new SolrResourceLoader for directory: 'file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip/collection1/'
14/12/23 17:06:52 ERROR core.CoreContainer: Failed to load file /home/potv360/creation_solr_perimetre_1/file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip/collection1/solrconfig.xml
14/12/23 17:06:52 ERROR core.CoreContainer: Unable to create core: collection1
org.apache.solr.common.SolrException: Could not load config for solrconfig.xml
	at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:605)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:670)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:365)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:356)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Can't find resource 'solrconfig.xml' in classpath or 'file:/tmp/hadoop-potv360/mapred/local/1419350810896/cb78eb38-cb06-4ad4-8a8f-d7b65ea65777.solr.zip/collection1/conf/', cwd=/home/potv360/creation_solr_perimetre_1
	at org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:322)
	at org.apache.solr.core.SolrResourceLoader.openConfig(SolrResourceLoader.java:287)
	at org.apache.solr.core.Config.<init>(Config.java:116)
	at org.apache.solr.core.Config.<init>(Config.java:86)
	at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:129)
	at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:602)
	... 9 more

 

 

Here is th command

 

hadoop --config /etc/hadoop/conf jar /opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/lib/hbase-solr/tools/hbase-indexer-mr-1.5-cdh5.2.0-job.jar --conf /etc/hbase/conf/hbase-site.xml -D mapred.child.java.opts=-Xmx500m --hbase-indexer-file /home/potv360/creation_solr_perimetre_1/test/morphline-hbase-mapper.xml --zk-host cuxnn01:2181,cuxnn01:2181,cuxsn01:2181/solr --collection test --go-live

 

Then runnig using the dry-mode, everything is ok. So it means acces to Hbase and mapping between Hbase Table and the instancedir schéma is fine.

And, then running the same process on the Cloudera VM, there's no trouble.

 

Have annyone meet the same situation,

thanks for the help

 

Gilbert

 

 

1,728
0 Kudos
1
Who agreed with this topic