Member since
09-30-2015
85
Posts
47
Kudos Received
10
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1116 | 04-18-2017 04:29 PM | |
| 3286 | 12-23-2016 06:32 PM | |
| 1661 | 12-22-2016 08:33 PM | |
| 2166 | 12-21-2016 10:15 PM | |
| 871 | 11-29-2016 04:40 PM |
02-28-2019
05:23 PM
Thank you for the very helpful article.
... View more
03-09-2017
11:50 PM
Although this will technically work, there is a supported way of doing this. The Falcon alert definition can specify the parameter to monitor for determining whether to use HTTP or HTTPS: {
"name": "falcon_server_webui",
"label": "Falcon Server Web UI",
"description": "This host-level alert is triggered if the Falcon Server Web UI is unreachable.",
"interval": 1,
"scope": "ANY",
"enabled": true,
"source": {
"type": "WEB",
"uri": {
"http": "{{falcon-env/falcon_port}}",
"https": "{{falcon-env/falcon_port}}",
"https_property": "{{hdfs-site/falcon.enableTLS}}",
"https_property_value": "true",
"default_port": 15000,
"kerberos_keytab": "{{falcon-startup.properties/*.falcon.http.authentication.kerberos.keytab}}",
"kerberos_principal": "{{falcon-startup.properties/*.falcon.http.authentication.kerberos.principal}}",
"connection_timeout": 5
},
"reporting": {
"ok": {
"text": "HTTP {0} response in {2:.3f}s"
},
"warning": {
"text": "HTTP {0} response from {1} in {2:.3f}s ({3})"
},
"critical": {
"text": "Connection failed to {1} ({3})"
}
}
}
}
Falcon should respect the port, regardless of plaintext vs encryption. However, this way, the alert framework will understand whether to use plaintext or TLS.
... View more
02-21-2018
07:08 PM
it works perfectly for me ! Thank's Ravi Gangappa
... View more
12-24-2016
05:58 PM
4 Kudos
ISSUE : If SOLR is configured as backend storage for ranger audits, ranger audit screen shows incorrect screen. This happens if server is running on any timezone other than UTC. ROOT CAUSE : 'ranger-admin-services.sh' script uses below command to start ranger. nohup java -Dproc_rangeradmin ${JAVA_OPTS} -Dlogdir=${RANGER_ADMIN_LOG_DIR} -Dcatalina.base=${XAPOLICYMGR_EWS_DIR} -cp "${XAPOLICYMGR_EWS_DIR}/webapp/WEB-INF/classes/conf:${XAPOLICYMGR_EWS_DIR}/lib/*:${RANGER_JAAS_LIB_DIR}/*:${RANGER_JAAS_CONF_DIR}:${JAVA_HOME}/lib/*:${RANGER_HADOOP_CONF_DIR}/*:$CLASSPATH" org.apache.ranger.server.tomcat.EmbeddedServer > ${RANGER_ADMIN_LOG_DIR}/catalina.out 2>&1 & If JAVA_OPTS value does not contain '-Duser.timezone=UTC', then Ranger admin runs in the local timezone.
This causes timezone issue in viewing audit on Ranger UI as Ranger admin doesn't return eventtime in UTC format. RESOLUTION : This is fixed under https://issues.apache.org/jira/browse/RANGER-1249 WORKAROUND : 1. Create a file ranger-admin-env-javaopts.sh in /usr/hdp/current/ranger-admin/conf/ on the ranger admin server 2. Add the below contents in to the file. export JAVA_OPTS=" ${JAVA_OPTS} -Duser.timezone=UTC" 3. chown ranger:ranger /usr/hdp/current/ranger-admin/conf/ranger-admin-env-javaopts.sh 4. chmod 755 /usr/hdp/current/ranger-admin/conf/ranger-admin-env-javaopts.sh 5. Restart Ranger admin.
... View more
Labels:
12-24-2016
03:20 AM
ok I reset the KDC credentials via the Manage KDC credentials button and I entered principal as admin/admin. now I am not getting locked out but if I try to reinstall KMS I am getting t he error below .. he is not finding the krb5.conf file . is there a setting in Kerberos which is messed up ? since as I stated earlier the TGT system is working fine on the command level for HIVE n HBASE ? ... 103 more
23 Dec 2016 22:16:33,131 WARN [ambari-client-thread-837] ServletHandler:561 - Error Processing URI: /api/v1/clusters/FDOT_Hadoop/hosts/hadoop1.abc.com/host_components/RANGER_KMS_SERVER - (java.lang.RuntimeException) Update Host request submission failed: org.apache.ambari.server.AmbariException: The 'krb5-conf' configuration is not available
23 Dec 2016 22:16:33,131 WARN [ambari-client-thread-837] ServletHandler:561 - Error Processing URI: /api/v1/clusters/FDOT_Hadoop/hosts/hadoop1.abc.com/host_components/RANGER_KMS_SERVER - (java.lang.RuntimeException) Update Host request submission failed: org.apache.ambari.server.AmbariException: The 'krb5-conf' configuration is not available
... View more
01-04-2017
10:09 PM
@rgangappa after restarting ambari I saw the same issue , but now it works . I still am not sure why this happened.
... View more
12-05-2016
11:49 PM
2 Kudos
ISSUE : Ranger HA fails if admin password is changed to non default password Error stack :
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/RANGER/0.4.0/package/scripts/ranger_admin.py", line 208, in <module>
RangerAdmin().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/RANGER/0.4.0/package/scripts/ranger_admin.py", line 59, in install
setup_ranger_admin_passwd_change()
File "/var/lib/ambari-agent/cache/common-services/RANGER/0.4.0/package/scripts/setup_ranger_xml.py", line 598, in setup_ranger_admin_passwd_change
Execute(cmd, environment={'JAVA_HOME': params.java_home, 'RANGER_ADMIN_HOME': params.ranger_home}, user=params.unix_user)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 273, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 71, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 93, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 141, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 294, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'ambari-python-wrap /usr/hdp/current/ranger-admin/db_setup.py -changepassword admin [PROTECTED] [PROTECTED]' returned 1. 2016-12-02 19:34:37,314 [I] DB FLAVOR :MYSQL
2016-12-02 19:34:37,314 [I] --------- Verifying Ranger DB connection ---------
2016-12-02 19:34:37,315 [I] Checking connection..
2016-12-02 19:34:37,315 [JISQL] /usr/jdk64/jdk1.8.0_77/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://gwy-ravi.ironman.com/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "SELECT version();"
2016-12-02 19:34:37,808 [I] Checking connection passed.
2016-12-02 19:34:37,809 [JISQL] /usr/jdk64/jdk1.8.0_77/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://gwy-ravi.ironman.com/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DEFAULT_ADMIN_UPDATE' and active = 'Y';"
2016-12-02 19:34:38,268 [JISQL] /usr/jdk64/jdk1.8.0_77/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://gwy-ravi.ironman.com/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DEFAULT_ADMIN_UPDATE' and active = 'N';"
2016-12-02 19:34:38,727 [JISQL] /usr/jdk64/jdk1.8.0_77/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://gwy-ravi.ironman.com/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('DEFAULT_ADMIN_UPDATE', now(), user(), now(), user(),'N') ;"
2016-12-02 19:34:39,192 [I] Ranger admin default password change request is in process..
Invalid user password
2016-12-02 19:34:49,401 [JISQL] /usr/jdk64/jdk1.8.0_77/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://gwy-ravi.ironman.com/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "delete from x_db_version_h where version='DEFAULT_ADMIN_UPDATE' and active='N';"
2016-12-02 19:34:49,865 [E] Ranger admin default password change request failed ROOT CAUSE : This is product defect and engineering are working on a fix. RESOLUTION / WORKAROUND : Set the ranger admin password to " admin " in both Ranger UI and Ambari -> Ranger Configs and retrigger Ranger HA installation. Once installation is complete, we can change the ranger admin password.
... View more
Labels:
12-05-2016
11:48 PM
1 Kudo
ISSUE : Ranger HA fails if admin password is changed to non default password Error stack :
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/RANGER/0.4.0/package/scripts/ranger_admin.py", line 208, in <module>
RangerAdmin().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/RANGER/0.4.0/package/scripts/ranger_admin.py", line 59, in install
setup_ranger_admin_passwd_change()
File "/var/lib/ambari-agent/cache/common-services/RANGER/0.4.0/package/scripts/setup_ranger_xml.py", line 598, in setup_ranger_admin_passwd_change
Execute(cmd, environment={'JAVA_HOME': params.java_home, 'RANGER_ADMIN_HOME': params.ranger_home}, user=params.unix_user)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 273, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 71, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 93, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 141, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 294, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'ambari-python-wrap /usr/hdp/current/ranger-admin/db_setup.py -changepassword admin [PROTECTED] [PROTECTED]' returned 1. 2016-12-02 19:34:37,314 [I] DB FLAVOR :MYSQL
2016-12-02 19:34:37,314 [I] --------- Verifying Ranger DB connection ---------
2016-12-02 19:34:37,315 [I] Checking connection..
2016-12-02 19:34:37,315 [JISQL] /usr/jdk64/jdk1.8.0_77/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://gwy-ravi.ironman.com/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "SELECT version();"
2016-12-02 19:34:37,808 [I] Checking connection passed.
2016-12-02 19:34:37,809 [JISQL] /usr/jdk64/jdk1.8.0_77/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://gwy-ravi.ironman.com/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DEFAULT_ADMIN_UPDATE' and active = 'Y';"
2016-12-02 19:34:38,268 [JISQL] /usr/jdk64/jdk1.8.0_77/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://gwy-ravi.ironman.com/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DEFAULT_ADMIN_UPDATE' and active = 'N';"
2016-12-02 19:34:38,727 [JISQL] /usr/jdk64/jdk1.8.0_77/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://gwy-ravi.ironman.com/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('DEFAULT_ADMIN_UPDATE', now(), user(), now(), user(),'N') ;"
2016-12-02 19:34:39,192 [I] Ranger admin default password change request is in process..
Invalid user password
2016-12-02 19:34:49,401 [JISQL] /usr/jdk64/jdk1.8.0_77/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://gwy-ravi.ironman.com/ranger -u 'rangeradmin' -p '********' -noheader -trim -c \; -query "delete from x_db_version_h where version='DEFAULT_ADMIN_UPDATE' and active='N';"
2016-12-02 19:34:49,865 [E] Ranger admin default password change request failed ROOT CAUSE : This is product defect and engineering are working on a fix RESOLUTION / WORKAROUND : Set the ranger admin password to " admin " in both Ranger UI and Ambari -> Ranger Configs and retrigger Ranger HA installation. Once installation is complete, we can change the ranger admin password.
... View more
Labels:
11-21-2016
09:37 PM
8 Kudos
ISSUE : When we click on Datanodes tab on Namenode UI, nothing happens.
ROOT CAUSE : This is happening because of https://issues.apache.org/jira/browse/HDFS-10888 and
https://issues.apache.org/jira/browse/HDFS-9193
which is fixed in Hadoop version 2.8. But HDP 2.5 is on Hadoop 2.7.
RESOLUTION/WORKAROUND : To resolve this, we can work around by
editing the below file on both the namenodes /usr/hdp/current/hadoop-hdfs-client/webapps/hdfs/dfshealth.js
and changing } else if (u.usedPercentage < 85) { to
} else if (v < 85) { We should be able to access datanode tabs after restarting namenode.
... View more
Labels:
11-22-2016
05:14 AM
Thanks guys for your active support , It was my network proxy issue , I disabled that n now whole registration of host and services are completed , But there is one issue here that I have installed almost service around 12-13 service like mapreduce , hive , spark, pig etc so on , there is some issue that services are toggling their state from start --> stop , automatically , but when I manually start thier corresponding services they will start again , is there any specific reason, In logs it is just showing connection to host:port is failed..
... View more