Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2452 | 04-27-2020 03:48 AM | |
4892 | 04-26-2020 06:18 PM | |
3978 | 04-26-2020 06:05 PM | |
3225 | 04-13-2020 08:53 PM | |
4934 | 03-31-2020 02:10 AM |
03-23-2017
12:55 AM
@Eun-seop Yu Your "/etc/hosts" entries does not look right.
Currently i see: 127.0.0.1 master.hadoop.com master
127.0.0.1 slave1.hadoop.com slave1
127.0.0.1 slave2.hadoop.com slave2
Because on the same host you can not assign same IP Address to multiple HDP cluster nodes. That will cause conflicts. Also When the agent will be installed then it's contents will be pushed to the "/var/lib/ambari-agent" & "/usr/lib/ambari-agent/" and "/etc/ambari-agent/"
So if you have the same host to install all the 3 nodes then you should be using Docker/VM not the local machine. Or Install a VirtualBox then create 3 VMs and then install ambari. Once you install the 3 nodes on 3 VMs then you can have the "/etc/hosts" entries with 3 different IPs as following: Example: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
172.20.115.110 jss1.example.com master
172.20.115.120 jss2.example.com slave1
172.20.115.130 jss3.example.com slave2 .
... View more
03-23-2017
12:39 AM
2 Kudos
@Javier Paez Before installing ambari-server can you please share & verify the output of the following commands # wget -nv http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.2.1.0/ambari.repo -O /etc/yum.repos.d/ambari.repo
# yum clean all
# yum info ambari-server
# ambari-server --version
# yum install ambari-server -y
In your yum output i see that it is using some cached entry as following: Loading mirror speeds from cached hostfile * base: sunsite.rediris.es * extras: sunsite.rediris.es * updates: sunsite.rediris.es Error: Nothing to do
Hence it is better to clear the yum cache first, you can use the following command. # yum clean all
If you are using any Http Proxy at your end then in the "~/.bash_profile" profile we can add the following: (here replace the "proxyHostName:3128" with proxy host and port number) export http_proxy=http://proxyHostName:3128/
export https_proxy=${http_proxy}
export ftp_proxy=${http_proxy}
Also please see: http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.1.0/bk_ambari_reference_guide/content/_how_to_set_up_an_internet_proxy_server_for_ambari.html
... View more
03-22-2017
05:43 PM
@Aditya Sharma
Is it a kerberized environment? If yes then have you set on the client side. export HADOOP_OPTS="-Djava.security.krb5.realm=YOUR.REALM.NAME -Djava.security.krb5.kdc=my.kdc.com . Also Can you pelas emake sure that "hbase-site.xml" file is present in clients classpath and your code knows the Zookeeper Addresses and those host and ports are accessible from your machine where you are running the java code. Example: config.set("hbase.zookeeper.quorum", "node1.example.com");
config.set("hbase.zookeeper.property.clientPort", "2181") .
... View more
03-22-2017
05:23 PM
@Aditya Sharma
Please define the "zookeeper.znode.parent" property in your code something like following: Configuration conf = HBaseConfiguration.create();
conf.set("zookeeper.znode.parent", "/hbase-unsecure"); . Parent value may differ in your case though but you can find the value of "zookeeper.znode.parent" in the "hbase-site.xml" file.
... View more
03-22-2017
05:18 PM
@Said Masoud
Your BaseDn is too open. Are you sure that is what you want. authentication.ldap.baseDn=dc
----> can it be authentication.ldap.baseDn=dc=example,dc=com
. The error "org.springframework.ldap.BadLdapGrammarException" indicates that incorrect value is specified as LDAP attributes. See: http://docs.spring.io/spring-ldap/docs/current/apidocs/org/springframework/ldap/BadLdapGrammarException.html
... View more
03-22-2017
04:05 PM
@Said Masoud Please check if the LDAP service is running or not? Because you are getting "<urlopen error [Errno 111] Connection refused>" If the LDAP is not running then you can start it. For OpenLDap something like following:
# service slapd start - Please check if the "authentication.ldap.primaryUrl" host& port mentioned in the following properly of the ambari.properties are accessible from ambari host or not? Example: # cat /etc/ambari-server/conf/ambari.properties | grep 'authentication.ldap.primaryUrl'
authentication.ldap.primaryUrl=erie1.example.com:389
# telnet erie1.example.com 389 - Also in your curl command you have an extra Quotation mark here [-d '"[{"Event"] where as it should be [-d '[{"Event"] example as following: curl -k -i -u admin:admin -H 'X-Requested-By: ambari' -X POST -d '[{"Event":{"specs":[{"principal_type":"users","sync_type":"all"},{"principal_type":"groups","sync_type":"all"}]}}]' https://127.0.0.1:8443/api/v1/ldap_sync_events
-
In your ambari-server.log there is some error related to DN as following so can you please share the output of the following command (if possible can you please share ambari-server.log and ambari.properties) # cat /etc/ambari-server/conf/ambari.properties | grep ldap
Example output:
----------------
# cat /etc/ambari-server/conf/ambari.properties | grep ldap
ambari.ldap.isConfigured=true
authentication.ldap.baseDn=dc=example,dc=com
authentication.ldap.bindAnonymously=false
authentication.ldap.dnAttribute=dn
authentication.ldap.groupMembershipAttr=memberUid
authentication.ldap.groupNamingAttr=cn
authentication.ldap.groupObjectClass=posixGroup
authentication.ldap.managerDn=cn=Manager,dc=example,dc=com
authentication.ldap.managerPassword=/etc/ambari-server/conf/ldap-password.dat
authentication.ldap.primaryUrl=erie1.example.com:389
authentication.ldap.referral=ignore
authentication.ldap.useSSL=false
authentication.ldap.userObjectClass=posixAccount
authentication.ldap.usernameAttribute=uid
client.security=ldap
Error Failed to parse DN; nested exception is org.springframework.ldap.core.ParseException: Encountered "<EOF>" at line 1, column 2. .
... View more
03-22-2017
03:45 PM
@saravanan gopalsamy
Sure, The Database queries should definitely work well as it leaves no foot print in the database of the service that we wanted to delete and completely cleans all the entries related to that mentioned service from the Database completely.
You will need to restart AmbariServer after making the database changes.
... View more
03-22-2017
03:32 PM
@saravanan gopalsamy
As mentioned earlier that you can
delete services from ambari UI from Ambari 2.4.x version else you will
have to use the Rest API as mentioned in the above link. In Ambari 2.2.1 that feature is not available in ambari UI. So you will need to either use the Ambari API or more simplest way is to delete the service directly from the Database as mentioned in the following article. . (Easiest and quick option) Deleting Service entry directly from Database using the following query:
delete from hostcomponentstate where service_name = 'KNOX';
delete from hostcomponentdesiredstate where service_name = 'KNOX';
delete from servicecomponentdesiredstate where service_name = 'KNOX';
delete from servicedesiredstate where service_name = 'KNOX';
delete from serviceconfighosts where service_config_id in (select service_config_id from serviceconfig where service_name = 'KNOX');
delete from serviceconfigmapping where service_config_id in (select service_config_id from serviceconfig where service_name = 'KNOX');
delete from serviceconfig where service_name = 'KNOX';
delete from requestresourcefilter where service_name = 'KNOX';
delete from requestoperationlevel where service_name = 'KNOX';
delete from clusterservices where service_name ='KNOX';
delete from clusterconfig where type_name like 'knox%';
delete from clusterconfigmapping where type_name like 'knox%';
. Please see: https://community.hortonworks.com/content/kbentry/81939/how-to-resolve-ambari-db-inconsistency-error-you-h.html
Then you will need to restart Ambari Server.
... View more
03-22-2017
01:58 PM
@saravanan gopalsamy Yes, Either you can remove the services from Ambari UI as following: Ambari UI --> Ambari Metrics Collector (Or any service that you want to delete) --> Service Action (Drop down menu) --> "Delete Service" (Button) . Or use the Ambari Rest API to do the same : https://cwiki.apache.org/confluence/display/AMBARI/Using+APIs+to+delete+a+service+or+all+host+components+on+a+host - Here is an example removing METRICS_COLLECTOR from a host. # curl -u admin -H "X-Requested-By: ambari" -X DELETE http://<AMBARI_HOST>:8080/api/v1/clusters/<CLUSTERNAME>/hosts/hdmdup0002.machine.test.group/host_components/METRICS_COLLECTOR - Which version of ambari are you using that also matters. Because you can delete services from ambari UI from Ambari 2.4.x version else you will have to use the Rest API as mentioned in the above link.
... View more
03-22-2017
12:30 PM
@Geoffrey Shelton Okot As per the "SolrDispatchFilter.java" code following is the logic which it uses to load the "solr.xml" file (from zookeeper) public static NodeConfig loadNodeConfig(Path solrHome, Properties nodeProperties) {
SolrResourceLoader loader = new SolrResourceLoader(solrHome, null, nodeProperties);
if (!StringUtils.isEmpty(System.getProperty("solr.solrxml.location"))) {
log.warn("Solr property solr.solrxml.location is no longer supported. " +
"Will automatically load solr.xml from ZooKeeper if it exists");
} . But in your mentioned log it looks like zookeeper is having some Kerberos issues "GSS initiate failed" and "Server not found in Kerberos database (7)"
. Can you check if you see valid kerberos tickets or if you are able to list the tickets or do a "kinit" ? 2017-01-23 16:08:36,087 [main-SendThread(10.176.69.1:2181)] ERROR [ ] org.apache.zookeeper.client.ZooKeeperSaslClient (ZooKeeperSaslClient.java:384) - An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - LOOKING_UP_SERVER)]) occurred when evaluating Zookeeper Quorum Member's received SASL token. Zookeeper Client will go to AUTH_FAILED state. .
... View more