Cloudera Community
amol_08
user rank
Guru

Manual installation of spark2-client

by Guru in Support Questions
‎03-20-2018 10:35 AM
‎03-20-2018 10:35 AM
I am manually installing spark2-clients , but i have some of confusion : yum search spark2 it lists out spark_<version>_<build>-master.noarch : Server for Spark 2 master spark_<version>_<build>-python.noarch : Python client for Spark 2 spark_<version>_<build>-worker.noarch : Server for Spark 2 worker spark_<version>_<build>.noarch : Lightning-Fast Cluster Computing yum install spark2_<version>-master spark_<version>-python but i want to install spark2-client , I am not sure what to install in order to install spark2-client only . when i run above commands it do create /usr/hdp/current/spark2-client but i guess it is also installing spark2 server . ... View more
Labels:

oozie spark2 action failing over rm

by Guru in Support Questions
‎03-16-2018 12:04 PM
‎03-16-2018 12:04 PM
I am trying to run oozie spark action but it is getting failed , i checked logs for the same , it is showing below error : 2018-03-16 07:38:10,319 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id 2018-03-16 07:38:10,771 WARN [main] org.apache.hadoop.ipc.Client: Failed to connect to server: rm1/oozie_server:8032: retries get failed due to exceeded maximum allowed retries number: 0 java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206 2018-03-1607:38:10,780 INFO [main] org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider:Failing over to rm2 I have some queries : 1. I have mentioned in value of jobtracker= rm1:8050 with this I was able to submit job earlier , is it necessary if now rm2 is in active state and rm1 is in standby then there is need to change value of jobtracker to rm2 , how to check what port rm2 is connecting . please help on this , I also run spark1 job jobtracker address as rm1 that job run successfully but spark2 is creating above problems . ... View more

Re: not able to register host

by Guru in Support Questions
‎03-13-2018 09:07 AM
‎03-13-2018 09:07 AM
@Jay Kumar SenSharma Thanks jay, It is working now . PasswordAuthentication yes it's value was set to no ... View more

Re: not able to register host

by Guru in Support Questions
‎03-13-2018 08:27 AM
‎03-13-2018 08:27 AM
@Jay Kumar SenSharma executed below command still getting same error : [root@host .ssh]# ssh-copy-id -i ~/.ssh/id_rsa.pub root@<host_fqdnt> Permission denied (publickey,gssapi-keyex,gssapi-with-mic). ... View more

not able to register host

by Guru in Support Questions
‎03-13-2018 07:55 AM
‎03-13-2018 07:55 AM
host registration with ambari getting failed . I am setting single node cluster , I am not able to do ssh to same node . I am following below steps on the same : 1. ssh-keygen 2. cat id_rsa.pub >> authorized_keys 3. chmod 700 ~/.ssh chmod 600 ~/.ssh/authorized_keys but when i do ssh host.FQDN it gives below error : The authenticity of host can't be established. Permission denied (publickey,gssapi-keyex,gssapi-with-mic). please help on this. Thanks in Advance ... View more
Labels:

Re: rest api to add user into ranger's policy

by Guru in Support Questions
‎03-09-2018 07:55 AM
‎03-09-2018 07:55 AM
@Jay Kumar SenSharma Hi Jay, but with update option i would need to take all users into list , for e.g. I want to append user abc in hdfs policy and there are already five users, is there rest api which can append only this abc user without mentioning other five uses in userList . and after execution of rest api user abc should be attached with other five users under the same policy ? ... View more

rest api to add user into ranger's policy

by Guru in Support Questions
‎03-09-2018 07:33 AM
‎03-09-2018 07:33 AM
I want to add user into existing ranger policy , Is there some rest api available so that i can append username in the rest api and in turn it directly attach that user to existing ranger policy like hdfs policy ..etc. ... View more
Labels:

ambari-server High availability (HA)

by Guru in Support Questions
‎03-08-2018 10:40 AM
‎03-08-2018 10:40 AM
Is there good demo or document available on ambari server high availability ? ... View more
Labels:

atlas tag based policy

by Guru in Support Questions
‎02-28-2018 01:25 PM
‎02-28-2018 01:25 PM
What is use of atlas tag based policy ?How does it really works ... View more
Labels:

Re: ambari rest api for metrics

by Guru in Support Questions
‎02-21-2018 07:56 AM
‎02-21-2018 07:56 AM
@Jay Kumar SenSharma Hi Jay, curl -v "http://amb25102.example.com:6188/ws/v1/timeline/metrics?metricNames=bytes_in._rate._avg&hostname=&appId=HOST&instanceId=&startTime=1451630974&endTime=1519110315" This rest api not working for For All kind of metrics:. I have replaced bytes_in._rate._avg to master.Server.numDeadRegionServers curl -v "http://amb25102.example.com:6188/ws/v1/timeline/metrics?metricNames=master.Server.numDeadRegionServers&hostname=&appId=HOST&instanceId=&startTime=1451630974&endTime=1519110315" but not able to get the metrics results . ... View more
Contact Me
Online
Offline
Last Visited
‎07-12-2021 03:39 AM
Community Statistics
Member Since ‎04-16-2019 11:04 PM
Last Visited ‎07-12-2021 03:39 AM
Posts 373
Kudos received 7