question Re: Can Ambari server and agent run on same host ? in Archives of Support Questions (Read Only)

Can Ambari server and agent run on same host ?

amjadcsu — Thu, 14 Jan 2016 14:05:25 GMT

Hello,

I am a newbie to horton and ambari. I am trying to make a 2 node hadoop cluster with physical server.

I am thinking of using Ambari to do provisioning. However since i only have 2 nodes, can i use Ambari server and ambari-agent on same node?

Right now if i do that, ambari-agent fails to startup and gives java unknown host exception . when i used FQDN

Thanks

Re: Can Ambari server and agent run on same host ?

jstraub — Thu, 14 Jan 2016 14:31:06 GMT

Yes thats possible and necessary if you want to add services to your Ambari-server node.

How does your Ambari Agent configuration look like?

Make sure you have prepared the environment according to http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.2.1/bk_Installing_HDP_AMB/content/_prepare_the_environment.html, especially DNS settings.

Re: Can Ambari server and agent run on same host ?

amjadcsu — Thu, 14 Jan 2016 15:37:14 GMT

Thanks Jonas for the reply.

The issue is now resolved but the ambari-server stuck on step 8,

Preparing to Deploy 0 of 42 tasks,

Please note , that i am behind proxy server

Re: Can Ambari server and agent run on same host ?

nsabharwal — Sun, 17 Jan 2016 08:53:10 GMT

@Majid Ali Syed Amjad Ali Sayed

I see your last comments and looks like that you are stuck on the install. Are you still facing the issue?

Re: Can Ambari server and agent run on same host ?

nsabharwal — Sun, 17 Jan 2016 08:56:37 GMT

@Majid Ali Syed Amjad Ali Sayed

I have 2 node cluster in my demo env.

Node 1 - Ambari server and agent

Node 2 - Ambari agent

Make sure that you have enough resources in the nodes. Anything less than 8GB cause issues like oom and very slow install.

java unknown host exception - This is related to your setup. Make sure that you use FQDN and both nodes can talk to each other.

hostname -f and hostname needs to be same.

Re: Can Ambari server and agent run on same host ?

aervits — Wed, 03 Feb 2016 05:20:01 GMT

@Majid Ali Syed Amjad Ali Sayed are you still having problems with this? Can you provide your own solution or accept best answer?

Re: Can Ambari server and agent run on same host ?

amjadcsu — Wed, 03 Feb 2016 15:07:56 GMT

Unfortunately, i am still stuck, the GUI just get stuck on step 8, Installing 8 of 42 tasks. and then timesout.

The logs say that both server and client can communicate and see each other heartbeat.

And yes i have configured proxy in ambari-env.sh

Re: Can Ambari server and agent run on same host ?

amjadcsu — Wed, 03 Feb 2016 15:11:26 GMT

My nodes have 10 GB RAM respectively . But still the gui just get stuck at step 8 , when i click deploy

Re: Can Ambari server and agent run on same host ?

Shelton — Wed, 03 Feb 2016 15:28:19 GMT

@Majid Ali Syed Amjad Ali Sayed

A 2 node cluster shouldn't pose alot of problems, YES the agent and Ambari server can runon te same host

Make sure you did all the belows steps successfully as the root user

1. Validate that your network setup is correct IP,Hostname FQDN etc

2. Run ssh-keygen and copy the id_rsa generated key to all the hosts and configuring passwordless SSH connect between the 2 servers for root user

2. Disable firewall / iptables on all the cluster hosts

3. Disable SELinux

4. Disable Transparent Huge Pages (THP)

5. Configure Database for ambari assuming you are using MySQL and dont forget to yum install mysql-connector-java and the appropriate permissions 644 and pre-load the Ambari database schema into your MySQL database

6. yum install ambari-server

7. ambari-server setup output Ambari Server 'setup' completed successfully.

8. Start the server #ambari-server start

1. Run ssh-keygen and copy the id_rsa generated key to all the hosts 2. Disable firewall / iptables on all the cluster hosts 3. Disable SELinux 4. Disable Transparent Huge Pages (THP) 6. Configure Database for ambari assuming you are using MySQL and dont forget to yum install mysql-connector-java and the appropriate permissions 644 and pre-load the Ambari database schema into your MySQL database

I recently did a 4 node cluster install without tweaking the proxy in ambari-env.sh

Could you paste the screen shot and logs in here

Re: Can Ambari server and agent run on same host ?

aervits — Wed, 03 Feb 2016 22:59:49 GMT

@Majid Ali Syed Amjad Ali Sayed

please post the results of the following command:

hostname -f

then post the contents of /etc/ambari-agent/conf/ambari-agent.ini

Re: Can Ambari server and agent run on same host ?

amjadcsu — Thu, 04 Feb 2016 14:29:46 GMT

Thanks Geoffrey for the reply.

Nodes hostname are krplhadoop,kaimrc and krplhadoop2.kaimrc .

tail -f /var/log/ambar-server/ambari-server.log

08:19:01,618 INFO HeartBeatHandler:108 - Received heartbeat from host, hostname=krplhadoop2.kaimrc, currentResponseId=25038, receivedResponseId=25038 08:19:01,618 INFO AgentResource:109 - Sending heartbeat response with response id 25039 08:19:11,579 INFO

ambari-freeze.png.

Re: Can Ambari server and agent run on same host ?

amjadcsu — Thu, 04 Feb 2016 14:33:24 GMT

hostname -f

krplhadoop.kaimrc

hostname -f

krplhadoop2.kaimrc

There is no file that is /etc/ambari-server/conf/ambari-server.ini

Re: Can Ambari server and agent run on same host ?

aervits — Thu, 04 Feb 2016 17:27:51 GMT

Sorry, my mistake, I edited the question. Please paste the contents of 2nd command

Re: Can Ambari server and agent run on same host ?

nsabharwal — Thu, 04 Feb 2016 18:44:54 GMT

@Majid Ali Syed Amjad Ali Sayed I have experienced this few times on slower nodes...patience 🙂

On serious note, check ambari log file and see whats happening there.

Re: Can Ambari server and agent run on same host ?

amjadcsu — Thu, 04 Feb 2016 18:54:25 GMT

Artem attaching the contents of 2 command

ambari.txt

Re: Can Ambari server and agent run on same host ?

aervits — Thu, 04 Feb 2016 18:55:50 GMT

@Majid Ali Syed Amjad Ali Sayed can you post the first 20 lines, I want to see your server proprties

Re: Can Ambari server and agent run on same host ?

amjadcsu — Thu, 04 Feb 2016 19:02:40 GMT

Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership.

# The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at

# # http://www.apache.org/licenses/LICENSE-2.0 # #

Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific

[server]

hostname=krplhadoop.kaimrc

url_port=8440

secured_url_port=8441

Re: Can Ambari server and agent run on same host ?

aervits — Thu, 04 Feb 2016 19:06:24 GMT

Now paste output of /etc/hosts @Majid Ali Syed Amjad Ali Sayed

Re: Can Ambari server and agent run on same host ?

amjadcsu — Thu, 04 Feb 2016 19:10:50 GMT

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4

::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

10.10.8.151 krplhadoop.kaimrc

10.10.8.152 krplhadoop2.kaimrc

Re: Can Ambari server and agent run on same host ?

aervits — Thu, 04 Feb 2016 19:13:25 GMT

@Majid Ali Syed Amjad Ali Sayed paste output of every command on the second node