Member since
01-25-2017
119
Posts
7
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
13698 | 04-11-2017 12:36 PM | |
4130 | 01-18-2017 10:36 AM |
02-10-2017
08:57 AM
Hi, After some trials on limited number of VMs I need to establish a Hadoop ecosystem on 12 physical servers. However, after all that reading and installations on VMs I feel little bit confused. I am going to install HDP (Most probably with Ambari and Zookeeper), Solr, Elastic Search and Hue. I am planning to set 3 of these servers for namenode high availability and set others as datanodes / slaves. In terms of placement of applications, that's all I have clear in my mind. What I am not clear about is placement of SOLR and Elastic search. Is it a bad, using datanode servers also for these applications? Should I set other servers as dedicated? Can I use high availability nodes also for other applications? In high availability mode, will MapReduce, Yarn and Spark server processes be operating on the high availability nodes? Are there any applications those needs to be on the same host (I am asking these questions especially for Solr, ES, Zookeeper, Hue)? Or you can skip all these questions if you have a reference which will give me a look from a broad perspective to these key point relations all together. I'll be glad if you can share your experience with me. Any comments appreciated 🙂
... View more
Labels:
- Labels:
-
Apache Hadoop
02-09-2017
09:46 AM
1 Kudo
Hi, I am having a problem with my Solr on Ambari + HDP Stack (Find detailed environment information at the end of question). My problem is the same as the one in this link. When I try to create a collection through Solr or create an index through Hue using a csv file, I get the below error: { "message": "{\"responseHeader\":{\"status\":400,\"QTime\":16025},\"error\":{\"metadata\":[\"error-class\",\"org.apache.solr.common.SolrException\",\"root-error-class\",\"org.apache.solr.common.cloud.ZooKeeperException\"],\"msg\":\"Error CREATEing SolrCore 'deneme': Unable to create core [deneme] Caused by: Could not find configName for collection deneme found:[twitter_demo, testCollMoney, collection1]\",\"code\":400}}\n (error 400)", "traceback": [ [ "/usr/local/hue/desktop/libs/libsolr/src/libsolr/api.py", 541, "create_core", "response = self._root.post('admin/cores', params=params, contenttype='application/json')" ], [ "/usr/local/hue/desktop/core/src/desktop/lib/rest/resource.py", 132, "post", "allow_redirects=allow_redirects, clear_cookies=clear_cookies)" ], [ "/usr/local/hue/desktop/core/src/desktop/lib/rest/resource.py", 81, "invoke", "clear_cookies=clear_cookies)" ], [ "/usr/local/hue/desktop/core/src/desktop/lib/rest/http_client.py", 173, "execute", "raise self._exc_class(ex)" ] ], "detail": null, "title": "Error while accessing Solr" } If I try to install examples on Hue, I get the below error: "responseHeader":{"status":400,"QTime":7},"error":{"metadata":["error-class","org.apache.solr.common.SolrException","root-error-class","java.lang.ClassNotFoundException"],"msg":"Error CREATEing SolrCore 'twitter_demo': Unable to create core [twitter_demo] Caused by: solr.ThaiWordFilterFactory","code":400}} The only was I can create a collection is uploading zookeeper config first then using ./solr create -c command (both manually on command line). I want to be able to create them over web ui. Story: First I installed Solr on Ambari while existing Ambari Infra Solr was working. When doing this, Ambari was not starting Solr with /infra-solr Zookeeper path. Today I removed Solr (keeping Infra-Solr but stopping it) on another host. Result was the same. One tip: even if this installation is a clean one, Solr installation canoeist the configs left from my very first manual Solr installation on tree view. Environment: Ambari: 2.4.2 HDP: 2.5.3 Solr: 6.4.0 from https://github.com/abajwa-hw/solr-stack (I changed the repo URL to 6.4.0) Hue: 3.11 on Docker (Centos 6.8) Thanks in advance.
... View more
Labels:
01-30-2017
03:44 PM
Hi, I was getting the following error for examples: Error CREATEing SolrCore 'twitter_demo_shard1_replica1': Unable to create core [twitter_demo_shard1_replica1] Caused by: You must set the HdfsDirectoryFactory param solr.hdfs.home for relative dataDir paths to work First I couldn't find where sold.hdfs.home was placed. Then I found this article and updated the solrConfig.xml file. Then I tried again to view existing examples but I still get this error. I checked the HDFS directory and confirmed that the path is there. Does anybody has a suggestion? Or idea?
... View more
01-18-2017
12:40 PM
My locale settings are as following
root@bigdev1 ~]# echo $LANG
en_US.utf8
[root@bigdev1 ~]# localectl status
System Locale: LANG=en_US.UTF-8
VC Keymap: tr
X11 Layout: tr
[root@bigdev1 ~]# locale
LANG=en_US.utf8
LC_CTYPE="en_US.utf8"
LC_NUMERIC="en_US.utf8"
LC_TIME="en_US.utf8"
LC_COLLATE="en_US.utf8"
LC_MONETARY="en_US.utf8"
LC_MESSAGES="en_US.utf8"
LC_PAPER="en_US.utf8"
LC_NAME="en_US.utf8"
LC_ADDRESS="en_US.utf8"
LC_TELEPHONE="en_US.utf8"
LC_MEASUREMENT="en_US.utf8"
LC_IDENTIFICATION="en_US.utf8"
LC_ALL=
[root@bigdev1 ~]# echo $LANG
en_US.utf8
... View more
01-18-2017
12:25 PM
@Sagar Shimpi, This may not be the proper answer. My friend made another installation recently on a cluster that I know very similar to my environment. He made an easy and clean install. I compared Ambari version, Java version, OS version, locale settings. They were all the same except Java version. He was using Java 8 update 77 while I used 8 update 112. I tried again with update 77 and result was the same. I also tried it again after changing $LANG variable to en_US.utf8. This setting is also Turkish on my friend's cluster. This change also did not work.
... View more
01-18-2017
10:36 AM
Hi @Sagar Shimpi, hi @hardik desai, I think I found the reason but I need to confirm, first. The problem is about my local settings. Did you notice anything weird in the exception? "Bad request: java.lang.IllegalArgumentException: No enum constant org.apache.ambari.server.state.kerberos.KerberosPrincipalType.SERVİCE" enum "service" in uppercase has the Turkish capital of letter: 'i' As String.toUpperCase() runs, service becomes SERVİCE instead of SERVICE Most probably changing the local settings will work. Actually this is something I apply before all installations because it is a common problem for our local but I forgot for this one.
... View more
01-17-2017
03:11 PM
@hardik desai, it is centos7. Java is 1.8.0_112 and HDP is 2.5.3 I can download anything with wget.
... View more
01-17-2017
02:11 PM
When following guide, after resetting ambari-server; I realized that I did not restart ambari agent on the host which also ambari-server runs.
... View more
01-17-2017
02:05 PM
I guess I'll try a fresh install of ambari following this page
... View more
01-17-2017
01:51 PM
I also tried with public repo. Result is the same...
... View more
- « Previous
- Next »