Thank you again!!   1) I have installed these client on my edge node 🙂   2) For instance, we decide that the cluster is not configured with kerberos   3) Actually, I want that end users could submit spark-shell 🙂   4) For this , I created a local user called "sparkuser" on the edge node   5) with which tool could client use the spark-shell? API? application? All I want that users can use the sparkuser that I have created on edge nôde to submit their scripts but I don't not want that these users access the edge node server directly (like remotelx or via an API? or else? I hope that I explained more 😄   Many thanks for your help and patience Asma   ... View more

In a nutshell, you don't need a Master process the edge node but Client to initiate communication with the Cluster   => Actually this is my question 🙂 Which client? Should I create a local user like spark and then ask the end users to use it in order to launch this command for example from their machines??   spark-sumbit  --master spark://edgenode:7077  calculPi.jar?   All that I need for now that the end  users could execute their scripts spark or Python ... from their side, how could we do this? do they need to access the edge server?   Thanks Asma ... View more

Thank you for your reply 🙂   I will explain my actual situation. I have installed Hadoop Cluster using ambari HortonWorks. One of nodes is an Edge node, I defined it as a spark master and I could then run spark-sumbit from this linux server (edge node) with spark user (spark) on 4 workers ( datanodes)   My question now, I will have developers and end users who should execute scripts from their local machine on the edge node. These users should not access directly the linux server (Edge node)  but they will have to launch scripts (spark-sumbit). How can I create accounts for them? How could they access the edge node ? Thanks Asma ... View more

Thank you for your reply   I tried to reinstall the oozie client and server ( I have one server and 4 clients machines) It has been installed on the server and one of client but failed for the 3 other with :   Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/hook.py", line 39, in <module> AfterInstallHook().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute method(env) File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/hook.py", line 32, in hook setup_stack_symlinks(self.stroutfile) File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/shared_initialization.py", line 66, in setup_stack_symlinks stack_select.select(package, json_version) File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 312, in select Execute(command, sudo=True) File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__ self.env.run() File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 263, in action_run returns=self.resource.returns) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner result = function(command, **kwargs) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy, returns=returns) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call raise ExecutionFailed(err_msg, code, out, err) resource_management.core.exceptions.ExecutionFailed: Execution of 'ambari-python-wrap /usr/bin/hdp-select set oozie-client 3.1.4.0-315' returned 1. symlink target /usr/hdp/current/oozie-client for oozie already exists and it is not a symlink.   Any idea please?   Thanks and Regards     ... View more

Should be the noexec ? ... View more

on all servers i have this 😞   [root@luapp698 tmp]# grep run_as /etc/ambari-agent/conf/ambari-agent.ini run_as_user=root [root@luapp698 tmp]# ^C [root@luapp698 tmp]# ambari-agent start bash: /var/lib/ambari-agent/bin/ambari-agent: Permission denied ... View more

yes it is the case   grep run_as /etc/ambari-agent/conf/ambari-agent.ini run_as_user=root   and   [root@server tmp]# ambari-agent start bash: /var/lib/ambari-agent/bin/ambari-agent: Permission denied i am with a root user ..   ... View more