Member since
12-31-2019
4
Posts
0
Kudos Received
0
Solutions
03-19-2020
11:18 AM
I am trying to upgrade my jdk1.8.0_172 to jdk1.8.0_241 in a kerberized cluster. I have followed this doc tuto upgrade jdk
The problem is, when I restared the cluster, some services installed in the ambari server host, won't start and failled with an error of : failled to connect I know that the doc is not for kerberized clusters, but I already copied my "/usr/jdk64/OLD/jdk1.8.0_172/jre/lib/security/jssecacerts" file into the new one. Even though, I still have the same problem, so I guess I am missing something here.
Does anyone know what is causing this problem ?
NB : I am runing DP_VERSION="3.1.5.0" and AMBARI_VERSION="2.7.5.0" Thanks
... View more
Labels:
02-04-2020
04:38 AM
I am working on a playbook so I can automate adding ranger policies for hdfs from a json file. So I am trying to fetch a json file with ranger hdfs policies in ansible playbook, here is the json file : {
"ranger_policies": [
{
"hdfs_policie": {
"policie": {
"name": "/lili R g_lab_test_pb1",
"path": "/lili",
"permissions": {
"groups": {
"name": "g_lab_test_pb1",
"accesses": [
"Read"
]
},
"users": {
"name": "lili",
"accesses": [
"Read",
"Write"
]
}
}
}
}
},
{
"hdfs_policie": {
"policie": {
"name": "/lala RX g_lab_test_pb1",
"path": "/lala",
"permissions": {
"groups": {
"name": "g_lab_test_pb1",
"accesses": [
"Read",
"Execute"
]
},
"users": {
"name": "lala",
"accesses": [
"Read",
"Write",
"Execute"
]
}
}
}
}
}
]
} And this is my playbook file : - name: "ranger policie hdfs"
vars:
jsonVar: "{{ lookup('file', 'users.json') | from_json }}"
ranger_hdfs_policies:
state: present
admin_url: "https://{{RANGER_ADMIN_SERVER}}:6182"
admin_username: "admin"
admin_password: "{{RANGER_ADMIN_PASSWORD}}"
validate_certs: no
service_name: "{{CLUSTER_NAME}}_hadoop"
policies:
- name: "{{ list.hdfs_policie.policie.name }}"
paths:
- "{{ list.hdfs_policie.policie.path }}"
permissions:
- groups:
- "{{ list.hdfs_policie.policie.permissions.groups.name }}"
accesses:
- "{{ list.hdfs_policie.policie.permissions.groups.accesses }}"
delegate_admin: true
- users:
- "{{ list.hdfs_policie.policie.permissions.users.name }}"
accesses:
- "{{ list.hdfs_policie.policie.permissions.users.accesses }}"
delegate_admin: true
loop: "{{ jsonVar.ranger_policies }}"
loop_control:
loop_var: list
tags:
- ranger_policies When passing this playbook, I get this error : "msg": "HDFS policy '/lala RX g_lab_test_pb1': : All items of list 'accesses' must be non null string" I don't know why it gives me this, because all the fields are satisfied. Is there anyone knows the source of this problem ? Thanks for advance.
... View more
Labels:
01-21-2020
02:51 AM
I was trying to sychnronize the ambari server with the ldap ipa using '/usr/sbin/ambari-server sync-ldap --all', which didn't pass, saying ambari-server were stoped (It was NOT), anyway I did a kill -9 to the ambari server process, and started it again. After that I passe the sync command with success. After this, yarn wouldn't start and gave me this error while trying to start resourcemanager :
stderr:
Traceback (most recent call last):
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call
raise ExecutionFailed(err_msg, code, out, err)
ExecutionFailed: Execution of 'ambari-sudo.sh -H -E test -f /var/run/hadoop-yarn/yarn/hadoop-yarn-resourcemanager.pid && ambari-sudo.sh -H -E pgrep -F /var/run/hadoop-yarn/yarn/hadoop-yarn-resourcemanager.pid' returned 1.
The above exception was the cause of the following exception:
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/YARN/package/scripts/resourcemanager.py", line 261, in
Resourcemanager().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/YARN/package/scripts/resourcemanager.py", line 144, in start
service('resourcemanager', action='start')
File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 89, in thunk
return fn(*args, **kwargs)
File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/YARN/package/scripts/service.py", line 116, in service
try_sleep=1,
File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 263, in action_run
returns=self.resource.returns)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy, returns=returns)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call
raise ExecutionFailed(err_msg, code, out, err)
Thanks in advance
... View more
Labels:
01-06-2020
05:18 AM
I facing the same problem, I can't find tagsync.pid on that location and in the ambari server it says : tagsync.pid doesn't exist after starting of the component. Did you found a solution ?
... View more