Member since
05-18-2018
25
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1314 | 02-27-2019 06:30 AM |
03-13-2019
01:16 PM
@Geoffrey Shelton Okot thanks for you i have database and users in mysql for ranger. this error happen before entering database information. from step assign slaves and clients to customize service. when i run "service check for YARN", bellow error happening: resource_management.core.exceptions.Fail: Resource Manager state is not available. Failed to determine the active Resource Manager web application address from myexample.hortonworks.com:8088
... View more
03-13-2019
05:58 AM
@Geoffrey Shelton Okot i trying to add ranger. for adding any services this error happening. i don't enable kerberos ... i enabling knoxsso for Ambari, Webhdfs, .... stackadvisor.out: 2019-03-10 15:09:29,172 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,172 INFO DefaultStackAdvisor getCapacitySchedulerProperties: - Retrieved 'capacity-scheduler' received as dictionary : 'True'. configs : [] 2019-03-10 15:09:29,172 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. stackadvisor.err: 2019-03-10 15:09:29,068 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,070 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,071 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,071 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,073 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,073 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,092 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,092 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,172 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,172 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services. 2019-03-10 15:09:29,172 ERROR DefaultStackAdvisor getCapacitySchedulerProperties: - Couldn't retrieve 'capacity-scheduler' from services.
... View more
03-03-2019
08:16 AM
Hi when i adding a service from Ambari ui bellow error happening: window error: ERROR 500 status code received on POST method for API: /api/v1/stacks/HDP/versions/3.0/recommendations Error message: Stack Advisor reported an error. Exit Code: 2. Error: ParseError: not well-formed (invalid token): line 65, column 12 StdOut file: /var/run/ambari-server/stack-recommendations/39/stackadvisor.out StdErr file: /var/run/ambari-server/stack-recommendations/39/stackadvisor.err when i login in to ambari by any user bellow error appear. ambari-server.log is: 2019-03-03 11:27:11,211 ERROR [ambari-metrics-retrieval-service-thread-37] AppCookieManager:122 - SPNego authentication failed, can not get h$ 2019-03-03 11:27:11,211 ERROR [ambari-metrics-retrieval-service-thread-35] AppCookieManager:122 - SPNego authentication failed, can not get h$ 2019-03-03 11:27:11,212 WARN [ambari-metrics-retrieval-service-thread-36] RequestTargetAuthentication:88 - NEGOTIATE authentication error: I$ 2019-03-03 11:27:11,212 WARN [ambari-metrics-retrieval-service-thread-34] RequestTargetAuthentication:88 - NEGOTIATE authentication error: I$ 2019-03-03 11:27:11,212 ERROR [ambari-metrics-retrieval-service-thread-36] AppCookieManager:122 - SPNego authentication failed, can not get h$ 2019-03-03 11:27:11,212 ERROR [ambari-metrics-retrieval-service-thread-34] AppCookieManager:122 - SPNego authentication failed, can not get h$ 2019-03-03 11:27:11,213 WARN [ambari-client-thread-870] RequestTargetAuthentication:88 - NEGOTIATE authentication error: Invalid name provid$ 2019-03-03 11:27:11,213 ERROR [ambari-client-thread-870] AppCookieManager:122 - SPNego authentication failed, can not get hadoop.auth cookie $ why i can't install any service? @Artem Ervits
... View more
Labels:
02-27-2019
06:30 AM
I checked so many paper and documents. Not to mention at all that the public key should be added to the /home/hdfs/ path. after adding public key to /home/hdfs/hadoop-keytab path the issue is resolved. if this file dont exist we creating. add public key to ----->/home/hdfs/hadoop-keytab
... View more
02-26-2019
11:52 AM
i following bellow steps to setup sso: Install Knox. Configure Ambari Authentication for LDAP/AD. Configure an LDAP/AD Identity Provider (IdP). Enable Knox SSO using the Ambari CLI. after this step sso worked me for redirect to ambari ui. in the next step when i add the bellow property to core-site.xml, restarting hdfs failed: "hadoop.http.authentication.type": "org.apache.hadoop.security.authentication.server.JWTRedirectAuthenticationHandler”
"hadoop.http.authentication.public.key.pem": “$SSOPUBLICKEY"
"hadoop.http.authentication.authentication.provider.url": "$SSOPROVIDERURL" when add this property ( hadoop.http.authentication.type ) to hdfs happening error. hdfs log file: 2019-02-26 16:28:06,366 ERROR datanode.DataNode (DataNode.java:secureMain(2870)) - Exception in secureMain
java.io.IOException: Problem starting http server Caused by:
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1165)
at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.<init>(DatanodeHttpServer.java:141)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:954)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1404)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:497)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2769)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)
javax.servlet.ServletException: javax.servlet.ServletException: Keytab does not exist: /home/hdfs/hadoop.keytab
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1165)
at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.<init>(DatanodeHttpServer.java:141)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:954)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1404)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:497)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2769)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)
how can resolve this issue?
... View more
Labels:
02-23-2019
08:27 AM
hi @Nixon Rodrigues thank you so much. for enable sso i following bellow steps: 1. install knox with ambari ui. 2. Configure Ambari Authentication for LDAP/AD. 3. Configure an LDAP/AD Identity Provider (IdP). 4. Enable Knox SSO using the Ambari CLI. 5. amabari server restart. is necessary i setup proxy or i use the default topology ?
... View more
02-19-2019
11:27 AM
Hey @Akhil S Naik thank you som much. when use this rest API i receive below response and not logged me out: HTTP/1.1 302 Found Date: Tuesday, February 19, 2019 2:49:23 PM IRST Access-Control-Allow-Credentials: true Access-Control-Allow-Headers: authorization,Content-Type Access-Control-Allow-Methods: POST, GET, OPTIONS, PUT, HEAD, DELETE X-FRAME-OPTIONS: X-XSS-Protection: 1 Set-Cookie: JSESSIONID=b2c32d5a-26f6-40cd-9ac4-4d94e474015d; Path=/; HttpOnly Location: http://$IP:9995/api/login;JSESSIONID=b2c32d5a-26f6-40cd-9ac4-4d94e474015d Content-Length: 0 Server: Jetty(9.2.15.v20160210)
... View more
02-17-2019
01:09 PM
i want configuration knoxsso for ambari. (ambari integrated with openldap) error in log file: 2019-02-17 16:25:17,090 ERROR knox.gateway (GatewayServlet.java:doFilter(174)) - Gateway processing failed: org.eclipse.jetty.io.EofException i want know how setup knoxxsso for ambari step by step. @Neeraj Sabharwal
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Knox
02-17-2019
11:52 AM
Hi i use the bellow command for login zeppelin rest api: curl -i --data 'userName=admin&password=mypassword' -X POST http://$ip:9995/api/login but for logout i dont find any rest api. for ambari i use the bellow link: https://192.168.0.2/owa/redir.aspx?C=28054dbf137f4a079826c3a372971604&URL=https%3a%2f%2fcommunity.hortonworks.com%2farticles%2f81758%2fhow-to-logout-ambaris-logged-in-user-using-ambari.html i want know how logout from zeppelin by rest api and cli.
... View more
Labels:
02-06-2019
06:10 AM
hi every one I followed the steps outlined in the link below to enable SSL and I received error a third step. Who knows what the problem is? Thanks for the better documentation if existing. link: https://community.hortonworks.com/articles/174302/configure-ssl-for-zeppelin-ui.html
... View more
Labels:
01-30-2019
12:19 PM
can you send me documentation for setup ldap/AD and ambari-server integration? i don't know what exactly do step by step.
... View more
01-30-2019
08:44 AM
Hi @Phil Zampino i have similar problem. finally what do you change ?
... View more
01-29-2019
04:52 AM
Hi @Akhil S Naik main problem is ssl in openldap. i want disable ssl in openldap. how reconfiguration openldap ?
... View more
01-28-2019
12:56 PM
because i don't currect add ssl to openldap, when i want to add ambari users i have problem. this reason i want disable ssl for openldap and re-config that. for bellow comment problem: #ldapsearch -x cn=user -b dc=hortonworks,dc=com
ldap_sasl_bind(SIMPLE): Can't contact LDAP server (-1)
and don't add any user to ldap: #ambari-server sync-ldap --all
Using python /usr/bin/python
Syncing with LDAP...
Enter Ambari Admin login: admin
Enter Ambari Admin password:
Fetching LDAP configuration from DB.
Syncing all...
Completed LDAP Sync.
Summary:
memberships:
removed = 0
created = 0
users:
skipped = 0
removed = 0
updated = 0
created = 0
groups:
updated = 0
removed = 0
created = 0
Ambari Server 'sync-ldap' completed successfully.
... View more
Labels:
01-21-2019
09:27 AM
thank you so much @Jay Kumar SenSharma for good answer. I wanted to make changes the file cluster-env.xml that auto start works properly. The way you said it changed the blueprint and it's perfectly correct, but my services are still starting after rebooting the system after about 40 minutes. can you tell me what i do step by step for active service auto start?
... View more
01-21-2019
08:28 AM
thank you @Sindhu i have problem with this step(step1 😞 1. Make sure Knox is configured properly and it works fine. what exactly i do for this step?
... View more
01-20-2019
09:19 AM
I want use Knox to secure ports like 50070 and WebHdfs requests. I'm confused among these papers. can someone explain step by step by example? For example, I use the following command to setup ldap, but I do not know the exact values of the parameters. ambari-server setup-ldap
Primary URL Host* : localhost
Primary URL Port* : 33389
Use SSL* [true/false] (false): false
User object class* (person): person
User name attribute* (uid): admin
Group object class* (posixGroup): posixGroup
Group name attribute* (cn): cn
Group member attribute* (memberUid): memberUid
Distinguished name attribute* (dn): dn
Base DN* (dc=ambari,dc=apache,dc=org): uid=admin,ou=people,dc=hadoop,dc=apache,dc=org
Bind anonymously* [true/false] (false): false
Handling behavior for username collisions [convert/skip] for LDAP sync* (convert): convert
ambari.ldap.connectivity.bind_dn: uid=admin,ou=people,dc=hadoop,dc=apache,dc=org
ambari.ldap.connectivity.bind_password: *****
Save settings [y/n] (y)? y
Also, when I use the following command. The answer is as follows: ambari-server sync-ldap --all
Using python /usr/bin/python
Syncing with LDAP...
Enter Ambari Admin login: admin
Enter Ambari Admin password:
Fetching LDAP configuration from DB.
Syncing all...ERROR: Exiting with exit code 1.
REASON: Caught exception running LDAP sync. Username cannot be empty myusers-ldif is same: # entry for sample user admin
dn: uid=admin,ou=people,dc=hadoop,dc=apache,dc=org
objectclass:top
objectclass:person
objectclass:organizationalPerson
objectclass:inetOrgPerson
cn: Admin
sn: Admin
uid: admin
userPassword:admin-password I want to understand exactly what things I need to do to use knox for security 50070 and other webui !!!
@Jay Kumar SenSharma
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Knox
01-15-2019
06:15 AM
i want change the following property in cluster-env.xml: <property>
<name>recovery_enabled</name>
<value>true</value>
<description>Auto start enabled or not for this cluster.</description>
<on-ambari-upgrade add="true"/>
</property>
<property>
<name>recovery_type</name>
<value>FULL</value>
<description>Auto start type.</description>
<on-ambari-upgrade add="true"/>
</property>
<property>
<name>recovery_lifetime_max_count</name>
<value>1024</value>
<description>Auto start lifetime maximum count of recovery attempt allowed per host component. This is reset when agent is restarted.</de$
<on-ambari-upgrade add="true"/>
</property>
<property>
<name>recovery_max_count</name>
<value>1</value>
<description>Auto start maximum count of recovery attempt allowed per host component in a window. This is reset when agent is restarted.<$
<on-ambari-upgrade add="true"/>
</property>
<property>
.
.
after change property do not any effect in Blueprints and if we see the value of property is different: is way to change this property in blueprints ?
... View more
Labels:
01-14-2019
01:02 PM
@Jay Kumar SenSharma thank you so much for good guide. in this case for service auto start, desired state is STARTED and current state is INSTALLED. for reason after system reboot, It takes about 60 minutes to start the components and recovered. change the cluster-env.xml property do not effect to service auto start and Blueprints. how can reduce time for service auto start? why edit cluster-env.xml do not effect on Blueprint and service auto start?
... View more
01-13-2019
06:20 AM
When I enable service auto start, after the reboot, most of
the components are not started, although I enable and checked recovery
enable is true for component with the following commands: curl -u admin:admin -H "X-Requested-By: ambari" -X PUT 'http://localhost:8080/api/v1/clusters/test/components?ServiceComponentInfo/component_name.in(APP_TIMELINE_SERVER,DATANODE,HBASE_MASTER,HBASE_REGIONSERVER,HISTORYSERVER,HIVE_METASTORE,HIVE_SERVER,INFRA_SOLR,LIVY_SERVER,LOGSEARCH_LOGFEEDER,LOGSEARCH_SERVER,METRICS_COLLECTOR,METRICS_GRAFANA,METRICS_MONITOR,MYSQL_SERVER,NAMENODE,NODEMANAGER,RESOURCEMANAGER,SECONDARY_NAMENODE,WEBHCAT_SERVER,ZOOKEEPER_SERVER)' -d '{"ServiceComponentInfo" : {"recovery_enabled":"true"}}' And checking recovery enabled with the below command : curl -u admin:admin -H "X-Requested-By: ambari" -X PUT 'http://localhost:8080/api/v1/clusters/test/components?ServiceComponentInfo/component_name.in(HBASE_REGIONSERVER)' -d '{"ServiceComponentInfo" : {"recovery_enabled":"true"}}' i see ambari agent log and understand that recoverymanager.py change state services to install, for example: <strong>INFO 2019-01-13 08:52:21,014 ComponentStatusExecutor.py:150 - Status for HST_AGENT has changed to INSTALLED
INFO 2019-01-13 08:52:21,014 RecoveryManager.py:157 - New status, current status is set to INSTALLED for HST_AGENT
INFO 2019-01-13 08:52:21,309 ComponentStatusExecutor.py:150 - Status for DRUID_BROKER has changed to INSTALLED
INFO 2019-01-13 08:52:21,309 RecoveryManager.py:163 - current status is set to INSTALLED for DRUID_BROKER
INFO 2019-01-13 08:52:21,602 ComponentStatusExecutor.py:150 - Status for OOZIE_CLIENT has changed to INSTALLED
INFO 2019-01-13 08:52:21,602 RecoveryManager.py:163 - current status is set to INSTALLED for OOZIE_CLIENT
</strong> After rebooting the system, the
main components are not started, that showed in captures, and about 1h
take to started all services. what the problem?
@Jay Kumar SenSharma
... View more
Labels:
09-24-2018
09:14 AM
tank you so much, after your answering i found it on documents hortonworks.
... View more
09-24-2018
04:55 AM
I did not understand, You may be guided. Your answer is not complete for me
... View more