Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.
prakashpunj
Rising Star
My Accepted Solutions
Show All

Re: Ranger Admin Not able to start

by Rising Star in Support Questions
‎03-20-2020 10:34 AM
‎03-20-2020 10:34 AM
Yes I did.. Is there a way I can check in MySql if the changes are applied. Thanks ... View more

Re: Ranger Admin Not able to start

by Rising Star in Support Questions
‎03-20-2020 07:37 AM
‎03-20-2020 07:37 AM
Tried that, getting the same error message. Thanks ... View more

Re: Ranger Admin Not able to start

by Rising Star in Support Questions
‎03-19-2020 05:21 PM
‎03-19-2020 05:21 PM
No help still not able to start ranger:   2020-03-19 20:20:10,288 [JISQL] /usr/jdk64/jdk1.8.0_112/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://namenode.asotc.com/mysql -u root -p '********' -noheader -trim -c \; -query "SELECT version();" Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary. SQLException : SQL state: 01S00 java.sql.SQLException: The server time zone value 'EDT' is unrecognized or represents more than one time zone. You must configure either the server or JDBC driver (via the 'serverTimezone' configuration property) to use a more specifc time zone value if you want to utilize time zone support. ErrorCode: 0 2020-03-19 20:20:11,050 [E] Can't establish db connection.. Exiting.. ... View more

Re: Ranger Admin Not able to start

by Rising Star in Support Questions
‎03-19-2020 04:23 PM
‎03-19-2020 04:23 PM
  select now command produce right result. Also I am putting below in the connection string which should address the issue ?serverTimezone=UTC     MariaDB [(none)]> select now(); +---------------------+ | now() | +---------------------+ | 2020-03-19 19:21:24 | +---------------------+ 1 row in set (0.00 sec)     ... View more

Ranger Admin Not able to start

by Rising Star in Support Questions
‎03-19-2020 02:07 PM
‎03-19-2020 02:07 PM
I have recently installed Ranger in my cluster and I am not able to start All database connection is OK. Below is the error. It's something about the time zone. I am using MySql, I am also attaching screen shot of main configuration.        stderr: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/RANGER/package/scripts/ranger_admin.py", line 236, in RangerAdmin().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute method(env) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/RANGER/package/scripts/ranger_admin.py", line 97, in start self.configure(env, upgrade_type=upgrade_type, setup_db=params.stack_supports_ranger_setup_db_on_start) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/RANGER/package/scripts/ranger_admin.py", line 132, in configure setup_ranger_xml.setup_ranger_db() File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/RANGER/package/scripts/setup_ranger_xml.py", line 267, in setup_ranger_db user=params.unix_user, File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__ self.env.run() File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 263, in action_run returns=self.resource.returns) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner result = function(command, **kwargs) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy, returns=returns) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call raise ExecutionFailed(err_msg, code, out, err) resource_management.core.exceptions.ExecutionFailed: Execution of 'ambari-python-wrap /usr/hdp/current/ranger-admin/dba_script.py -q' returned 1. 2020-03-19 16:56:38,687 [I] Running DBA setup script. QuiteMode:True 2020-03-19 16:56:38,687 [I] Using Java:/usr/jdk64/jdk1.8.0_112/bin/java 2020-03-19 16:56:38,687 [I] DB FLAVOR:MYSQL 2020-03-19 16:56:38,687 [I] DB Host:namenode.asotc.com 2020-03-19 16:56:38,688 [I] ---------- Verifying DB root password ---------- 2020-03-19 16:56:38,688 [I] DBA root user password validated 2020-03-19 16:56:38,688 [I] ---------- Verifying Ranger Admin db user password ---------- 2020-03-19 16:56:38,688 [I] admin user password validated 2020-03-19 16:56:38,689 [I] ---------- Creating Ranger Admin db user ---------- 2020-03-19 16:56:38,689 [JISQL] /usr/jdk64/jdk1.8.0_112/bin/java -cp /usr/hdp/current/ranger-admin/ews/lib/mysql-connector-java.jar:/usr/hdp/current/ranger-admin/jisql/lib/* org.apache.util.sql.Jisql -driver mysqlconj -cstring jdbc:mysql://namenode.asotc.com/mysql -u root -p '********' -noheader -trim -c \; -query "SELECT version();" Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary. SQLException : SQL state: 01S00 java.sql.SQLException: The server time zone value 'EDT' is unrecognized or represents more than one time zone. You must configure either the server or JDBC driver (via the 'serverTimezone' configuration property) to use a more specifc time zone value if you want to utilize time zone support. ErrorCode: 0 2020-03-19 16:56:39,340 [E] Can't establish db connection.. Exiting..     ... View more
Labels:

Can't access file manager using HUE admin ( 4.0.1)

by Rising Star in Support Questions
‎03-13-2020 02:51 PM
‎03-13-2020 02:51 PM
I am getting the following error when I access HDFS file browser using HUE as admin: I changed this:  dfs.permission.enabled - changed to false but still getting the same error     Cannot access: //. The HDFS REST service is not available. Note: you are a Hue admin but not a HDFS superuser, "hdfs" or part of HDFS supergroup, "supergroup".       ... View more
Labels:

Re: Hue 3.8.1 on centos 7 - How to start it

by Rising Star in Support Questions
‎03-12-2020 07:48 PM
1 Kudo
‎03-12-2020 07:48 PM
1 Kudo
@stevenmatison    So I changed Hue directory permission to hue user and that fixed the issue.. ... View more

Re: Hue 3.8.1 on centos 7 - How to start it

by Rising Star in Support Questions
‎03-12-2020 06:17 PM
‎03-12-2020 06:17 PM
@stevenmatison    So what permission do I need to change to which file ?   I changed the permission to 777 to desktop.db which is under desktop folder but no help.    Thanks   ... View more

Re: Hue 3.8.1 on centos 7 - How to start it

by Rising Star in Support Questions
‎03-12-2020 07:54 AM
‎03-12-2020 07:54 AM
I managed to install it (version 4.x) of hue on centos but when I hit it from the browser, here is what I get rather than a login screen.    This is what I see when I run the supervisor [hue@ds hue-4.0.0]$ sudo build/env/bin/supervisor [sudo] password for hue: starting server with options: {'daemonize': False, 'host': 'ds.asotc.com', 'pidfile': None, 'port': 8888, 'server_group': 'hue', 'server_name': 'localhost', 'server_user': 'hue', 'ssl_certificate': None, 'ssl_certificate_chain': None, 'ssl_cipher_list': 'ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA', 'ssl_private_key': None, 'threads': 40, 'workdir': None}   Traceback (most recent call last): File "/home/hue/hue-4.0.0/desktop/core/src/desktop/lib/wsgiserver.py", line 1215, in communicate req.respond() File "/home/hue/hue-4.0.0/desktop/core/src/desktop/lib/wsgiserver.py", line 576, in respond self._respond() File "/home/hue/hue-4.0.0/desktop/core/src/desktop/lib/wsgiserver.py", line 588, in _respond response = self.wsgi_app(self.environ, self.start_response) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/wsgi.py", line 206, in __call__ response = self.get_response(request) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/base.py", line 153, in get_response response = self.handle_uncaught_exception(request, resolver, sys.exc_info()) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/base.py", line 236, in handle_uncaught_exception return callback(request, **param_dict) File "/home/hue/hue-4.0.0/desktop/core/src/desktop/views.py", line 380, in serve_500_error return render("500.mako", request, {'traceback': traceback.extract_tb(exc_info[2])}) File "/home/hue/hue-4.0.0/desktop/core/src/desktop/lib/django_util.py", line 230, in render **kwargs) File "/home/hue/hue-4.0.0/desktop/core/src/desktop/lib/django_util.py", line 148, in _render_to_response return django_mako.render_to_response(template, *args, **kwargs) File "/home/hue/hue-4.0.0/desktop/core/src/desktop/lib/django_mako.py", line 125, in render_to_response return HttpResponse(render_to_string(template_name, data_dictionary), **kwargs) File "/home/hue/hue-4.0.0/desktop/core/src/desktop/lib/django_mako.py", line 114, in render_to_string_normal result = template.render(**data_dict) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Mako-0.8.1-py2.7.egg/mako/template.py", line 443, in render return runtime._render(self, self.callable_, args, data) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Mako-0.8.1-py2.7.egg/mako/runtime.py", line 786, in _render **_kwargs_for_callable(callable_, data)) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Mako-0.8.1-py2.7.egg/mako/runtime.py", line 818, in _render_context _exec_template(inherit, lclcontext, args=args, kwargs=kwargs) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Mako-0.8.1-py2.7.egg/mako/runtime.py", line 844, in _exec_template callable_(context, *args, **kwargs) File "/tmp/tmpnJ8DqA/desktop/500.mako.py", line 120, in render_body __M_writer(unicode( commonfooter(request, messages) )) File "/home/hue/hue-4.0.0/desktop/core/src/desktop/views.py", line 494, in commonfooter hue_settings = Settings.get_settings() File "/home/hue/hue-4.0.0/desktop/core/src/desktop/models.py", line 109, in get_settings settings, created = Settings.objects.get_or_create(id=1) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/manager.py", line 154, in get_or_create return self.get_queryset().get_or_create(**kwargs) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 391, in get_or_create six.reraise(*exc_info) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 383, in get_or_create obj.save(force_insert=True, using=self.db) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/base.py", line 545, in save force_update=force_update, update_fields=update_fields) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/base.py", line 573, in save_base updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/base.py", line 654, in _save_table result = self._do_insert(cls._base_manager, using, fields, update_pk, raw) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/base.py", line 687, in _do_insert using=using, raw=raw) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/manager.py", line 232, in _insert return insert_query(self.model, objs, fields, **kwargs) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/query.py", line 1514, in insert_query return query.get_compiler(using=using).execute_sql(return_id) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/models/sql/compiler.py", line 903, in execute_sql cursor.execute(sql, params) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/util.py", line 53, in execute return self.cursor.execute(sql, params) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/utils.py", line 99, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/util.py", line 53, in execute return self.cursor.execute(sql, params) File "/home/hue/hue-4.0.0/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/backends/sqlite3/base.py", line 452, in execute return Database.Cursor.execute(self, query, params) OperationalError: attempt to write a readonly database   ... View more

Re: Hue 3.8.1 on centos 7 - How to start it

by Rising Star in Support Questions
‎03-12-2020 05:47 AM
‎03-12-2020 05:47 AM
I see supervisor.py file got created in different folder than /usr/local/hue. It's in desktop/core/src/desktop folder. I am running as root. Below is what I get   [root@ds desktop]# pwd /root/hue-3.8.1/desktop/core/src/desktop [root@ds desktop]# ./supervisor -bash: ./supervisor: No such file or directory [root@ds desktop]# ./supervisor.py -bash: ./supervisor.py: Permission denied [root@ds desktop]# chmod 777 supervisor.py [root@ds desktop]# ./supervisor.py Traceback (most recent call last): File "./supervisor.py", line 32, in <module> from daemon.pidlockfile import PIDLockFile ImportError: No module named daemon.pidlockfile     ... View more

Superset - Default name and password

by Rising Star in Support Questions
‎03-11-2020 07:52 PM
‎03-11-2020 07:52 PM
I have installed SuperSet on Ambari 2.7 but don't know what's the default name and password. How to reset it...   Thanks Prakash ... View more
Labels:

Hue 3.8.1 on centos 7 - How to start it

by Rising Star in Support Questions
‎03-11-2020 06:05 PM
‎03-11-2020 06:05 PM
I have installed Hue 3.8.1 from tarball and it's running on centos 7. I am not sure how to start hue.    Below is the directory structure.   [root@ds hue-3.8.1]# ls -l total 56 drwxrwxr-x. 21 sitadmin sitadmin 4096 May 4 2015 apps drwxr-xr-x. 3 root root 17 Mar 10 23:14 build drwxrwxr-x. 5 sitadmin sitadmin 58 May 4 2015 desktop drwxrwxr-x. 6 sitadmin sitadmin 142 May 4 2015 docs drwxrwxr-x. 3 sitadmin sitadmin 24 May 4 2015 ext -rw-rw-r--. 1 sitadmin sitadmin 11358 May 4 2015 LICENSE.txt -rw-rw-r--. 1 sitadmin sitadmin 4715 May 4 2015 Makefile -rw-rw-r--. 1 sitadmin sitadmin 8505 May 4 2015 Makefile.sdk -rw-rw-r--. 1 sitadmin sitadmin 3498 May 4 2015 Makefile.vars -rw-rw-r--. 1 sitadmin sitadmin 2192 May 4 2015 Makefile.vars.priv drwxrwxr-x. 2 sitadmin sitadmin 21 May 4 2015 maven -rw-rw-r--. 1 sitadmin sitadmin 801 May 4 2015 NOTICE.txt -rw-rw-r--. 1 sitadmin sitadmin 1562 May 4 2015 README drwxrwxr-x. 5 sitadmin sitadmin 89 May 4 2015 tools -rw-rw-r--. 1 sitadmin sitadmin 932 May 4 2015 VERSION     ... View more
Labels:

Ambari Serve and Agent on the same host machine

by Rising Star in Support Questions
‎02-28-2020 03:47 PM
‎02-28-2020 03:47 PM
For evaluation purpose, I am planning to install everything on the same host machine. Do I have to install Ambari-Agent also before I can add the host machine as a node in the cluster ??   Thanks ... View more
Labels:

Re: Ambari host registration issue

by Rising Star in Support Questions
‎02-28-2020 02:48 PM
‎02-28-2020 02:48 PM
Some more info:   INFO 2020-02-28 02:59:33,768 PingPortListener.py:50 - Ping port listener started on port: 8670 INFO 2020-02-28 02:59:33,771 main.py:439 - Connecting to Ambari server at https://hdp.0lw5ekcxj3kufbug3aze5gfphe.bx.internal.cloudapp.net:8440 (127.0.0.1) INFO 2020-02-28 02:59:33,771 NetUtil.py:70 - Connecting to https://hdp.0lw5ekcxj3kufbug3aze5gfphe.bx.internal.cloudapp.net:8440/ca INFO 2020-02-28 02:59:33,841 main.py:449 - Connected to Ambari server hdp.0lw5ekcxj3kufbug3aze5gfphe.bx.internal.cloudapp.net INFO 2020-02-28 02:59:33,852 hostname.py:67 - agent:hostname_script configuration not defined thus read hostname 'HDP' using socket.getfqdn(). INFO 2020-02-28 02:59:33,853 threadpool.py:58 - Started thread pool with 3 core threads and 20 maximum threads WARNING 2020-02-28 02:59:33,853 AlertSchedulerHandler.py:280 - [AlertScheduler] /var/lib/ambari-agent/cache/alerts/definitions.json not found or invalid. No alerts will be scheduled until registration occurs. INFO 2020-02-28 02:59:33,853 AlertSchedulerHandler.py:175 - [AlertScheduler] Starting <ambari_agent.apscheduler.scheduler.Scheduler object at 0x7fe60a61cfd0>; currently running: False INFO 2020-02-28 02:59:33,865 hostname.py:106 - Read public hostname 'hdp' using socket.getfqdn() INFO 2020-02-28 02:59:33,865 Hardware.py:68 - Initializing host system information. INFO 2020-02-28 02:59:33,874 Hardware.py:188 - Some mount points were ignored: /dev/shm, /run, /sys/fs/cgroup, /run/user/1000 INFO 2020-02-28 02:59:33,894 hostname.py:67 - agent:hostname_script configuration not defined thus read hostname 'HDP' using socket.getfqdn(). INFO 2020-02-28 02:59:33,900 Facter.py:202 - Directory: '/etc/resource_overrides' does not exist - it won't be used for gathering system resources. INFO 2020-02-28 02:59:33,905 Hardware.py:73 - Host system information: {'kernel': 'Linux', 'domain': '', 'physicalprocessorcount': 2, 'kernelrelease': '3.10.0-1062.9.1.el7.x86_64', 'uptime_days': '0', 'memorytotal': 7990252, 'swapfree': '2.00 GB', 'memorysize': 7990252, 'osfamily': 'redhat', 'swapsize': '2.00 GB', 'processorcount': 2, 'netmask': '255.255.255.0', 'timezone': 'UTC', 'hardwareisa': 'x86_64', 'memoryfree': 1985308, 'operatingsystem': 'redhat', 'kernelmajversion': '3.10', 'kernelversion': '3.10.0', 'macaddress': '00:0D:3A:8A:DE:15', 'operatingsystemrelease': '7.7', 'ipaddress': '10.0.0.8', 'hostname': 'hdp', 'uptime_hours': '12', 'fqdn': 'hdp', 'id': 'root', 'architecture': 'x86_64', 'selinux': True, 'mounts': [{'available': '3983556', 'used': '0', 'percent': '0%', 'device': 'devtmpfs', 'mountpoint': '/dev', 'type': 'devtmpfs', 'size': '3983556'}, {'available': '2016956', 'used': '69956', 'percent': '4%', 'device': '/dev/mapper/rootvg-rootlv', 'mountpoint': '/', 'type': 'xfs', 'size': '2086912'}, {'available': '8762208', 'used': '1713312', 'percent': '17%', 'device': '/dev/mapper/rootvg-usrlv', 'mountpoint': '/usr', 'type': 'xfs', 'size': '10475520'}, {'available': '384244', 'used': '121336', 'percent': '24%', 'device': '/dev/sda2', 'mountpoint': '/boot', 'type': 'xfs', 'size': '505580'}, {'available': '501824', 'used': '9896', 'percent': '2%', 'device': '/dev/sda1', 'mountpoint': '/boot/efi', 'type': 'vfat', 'size': '511720'}, {'available': '2053688', 'used': '33224', 'percent': '2%', 'device': '/dev/mapper/rootvg-tmplv', 'mountpoint': '/tmp', 'type': 'xfs', 'size': '2086912'}, {'available': '4209180', 'used': '4169188', 'percent': '50%', 'device': '/dev/mapper/rootvg-varlv', 'mountpoint': '/var', 'type': 'xfs', 'size': '8378368'}, {'available': '1005240', 'used': '33096', 'percent': '4%', 'device': '/dev/mapper/rootvg-homelv', 'mountpoint': '/home', 'type': 'xfs', 'size': '1038336'}, {'available': '1943884', 'used': '143028', 'percent': '7%', 'device': '/dev/mapper/rootvg-optlv', 'mountpoint': '/opt', 'type': 'xfs', 'size': '2086912'}, {'available': '46685624', 'used': '2150432', 'percent': '5%', 'device': '/dev/sdb1', 'mountpoint': '/mnt/resource', 'type': 'ext4', 'size': '51473824'}], 'hardwaremodel': 'x86_64', 'uptime_seconds': '46242', 'interfaces': 'eth0,lo'} @                                                                                                                                                                                     @                                                                                                                                                                                     @                                                                                                                                                       ... View more

Ambari host registration issue

by Rising Star in Support Questions
‎02-28-2020 02:44 PM
‎02-28-2020 02:44 PM
I have installed Ambari-server and agent on the same host but not able to add them as part of the ambari cluster as it fails to register. Below is the output of Ambari-agent.log file.        INFO 2020-02-28 02:59:33,768 PingPortListener.py:50 - Ping port listener started on port: 8670 INFO 2020-02-28 02:59:33,771 main.py:439 - Connecting to Ambari server at https://hdp.0lw5ekcxj3kufbug3aze5gfphe.bx.internal.cloudapp.net:8440 (127.0.0.1) INFO 2020-02-28 02:59:33,771 NetUtil.py:70 - Connecting to https://hdp.0lw5ekcxj3kufbug3aze5gfphe.bx.internal.cloudapp.net:8440/ca INFO 2020-02-28 02:59:33,841 main.py:449 - Connected to Ambari server hdp.0lw5ekcxj3kufbug3aze5gfphe.bx.internal.cloudapp.net INFO 2020-02-28 02:59:33,852 hostname.py:67 - agent:hostname_script configuration not defined thus read hostname 'HDP' using socket.getfqdn(). INFO 2020-02-28 02:59:33,853 threadpool.py:58 - Started thread pool with 3 core threads and 20 maximum threads WARNING 2020-02-28 02:59:33,853 AlertSchedulerHandler.py:280 - [AlertScheduler] /var/lib/ambari-agent/cache/alerts/definitions.json not found or invalid. No alerts will be scheduled until registration occurs. "/var/log/ambari-agent/ambari-agent.log" [readonly] 414L, 50499C ... View more
Labels:

Downgrade from HDP 2.6.5 to 2.6.0.3

by Rising Star in Support Questions
‎07-21-2018 02:35 AM
‎07-21-2018 02:35 AM
I need to downgrade to hdp 2.6.0 from 2.6.5, I am able to register it but not able to install. ... View more

Re: java update Ambari

by Rising Star in Support Questions
‎07-16-2018 02:29 AM
‎07-16-2018 02:29 AM
Thanks @Jay Kumar SenSharma. Question: On other nodes, do we have to do anything after installing new version of JAVA. Just by putting the JAVA in the same path as Ambari-server, is that going to be ok..? ... View more

java update Ambari

by Rising Star in Support Questions
‎07-16-2018 01:26 AM
‎07-16-2018 01:26 AM
I need to update Oracle JDK to 8u172. What's the best way of doing it. Is there a documentation ... View more
Labels:

Re: Heartbeat lost

by Rising Star in Support Questions
‎07-16-2018 01:22 AM
‎07-16-2018 01:22 AM
Thank you @Jay Kumar SenSharma It did fixed the problem but wondering why it was working before and stopped working after a VM restart ... View more

Heartbeat lost

by Rising Star in Support Questions
‎07-11-2018 01:26 AM
‎07-11-2018 01:26 AM
I have few VM in Azure cloud. Upgraded memory on all the VM's and after reboot, looks like all the cluster members are not able to talk to Ambari server. What could be wrong p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff} span.s1 {font-variant-ligatures: no-common-ligatures} INFO 2018-07-11 01:20:43,857 NetUtil.py:70 - Connecting to https://dev1:8440/ca ERROR 2018-07-11 01:20:43,863 NetUtil.py:96 - EOF occurred in violation of protocol (_ssl.c:579) ERROR 2018-07-11 01:20:43,863 NetUtil.py:97 - SSLError: Failed to connect. Please check openssl library versions. Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details. WARNING 2018-07-11 01:20:43,863 NetUtil.py:124 - Server at https://dev1:8440 is not reachable, sleeping for 10 seconds... INFO 2018-07-11 01:20:53,864 main.py:439 - Connecting to Ambari server at https://dev1:8440 (10.0.0.11) INFO 2018-07-11 01:20:53,864 NetUtil.py:70 - Connecting to https://dev1:8440/ca ERROR 2018-07-11 01:20:53,869 NetUtil.py:96 - EOF occurred in violation of protocol (_ssl.c:579) ERROR 2018-07-11 01:20:53,869 NetUtil.py:97 - SSLError: Failed to connect. Please check openssl library versions. Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details. WARNING 2018-07-11 01:20:53,869 NetUtil.py:124 - Server at https://dev1:8440 is not reachable, sleeping for 10 seconds... INFO 2018-07-11 01:21:03,869 NetUtil.py:70 - Connecting to https://dev1:8440/ca ERROR 2018-07-11 01:21:03,874 NetUtil.py:96 - EOF occurred in violation of protocol (_ssl.c:579) ERROR 2018-07-11 01:21:03,874 NetUtil.py:97 - SSLError: Failed to connect. Please check openssl library versions. Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details. WARNING 2018-07-11 01:21:03,874 NetUtil.py:124 - Server at https://dev1:8440 is not reachable, sleeping for 10 seconds... INFO 2018-07-11 01:21:13,875 NetUtil.py:70 - Connecting to https://dev1:8440/ca ERROR 2018-07-11 01:21:13,880 NetUtil.py:96 - EOF occurred in violation of protocol (_ssl.c:579) ERROR 2018-07-11 01:21:13,880 NetUtil.py:97 - SSLError: Failed to connect. Please check openssl library versions. Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details. WARNING 2018-07-11 01:21:13,880 NetUtil.py:124 - Server at https://dev1:8440 is not reachable, sleeping for 10 seconds... INFO 2018-07-11 01:21:23,881 NetUtil.py:70 - Connecting to https://dev1:8440/ca ERROR 2018-07-11 01:21:23,886 NetUtil.py:96 - EOF occurred in violation of protocol (_ssl.c:579) ERROR 2018-07-11 01:21:23,886 NetUtil.py:97 - SSLError: Failed to connect. Please check openssl library versions. Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details. WARNING 2018-07-11 01:21:23,886 NetUtil.py:124 - Server at https://dev1:8440 is not reachable, sleeping for 10 seconds. Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details. WARNING 2018-07-11 01:17:13,729 NetUtil.py:124 - Server at https://dev1:8440 is not reachable, sleeping for 10 seconds... INFO 2018-07-11 01:17:23,730 NetUtil.py:70 - Connecting to https://dev1:8440/ca ERROR 2018-07-11 01:17:23,734 NetUtil.py:96 - EOF occurred in violation of protocol (_ssl.c:579) ERROR 2018-07-11 01:17:23,734 NetUtil.py:97 - SSLError: Failed to connect. Please check openssl library versions. Refer to: https://bugzilla.redhat.com/show_bug.cgi?id=1022468 for more details. WARNING 2018-07-11 01:17:23,734 NetUtil.py:124 - Server at https://dev1:8440 is not reachable, sleeping for 10 seconds.. ... View more
Labels:

Error installing components

by Rising Star in Support Questions
‎06-27-2018 06:32 PM
‎06-27-2018 06:32 PM
Hi ! I am trying to deploy a new cluster on AWS with the following specs: RHEL 7.5, Ambari 2.6.2, HDP 2.6.5. After registering the node, when I add the components it fails. Below are the log from one of the nodes. How can I skip it to install other components if one is giving issue. Please help.. 2018-06-27 18:05:21,063 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6 2018-06-27 18:05:21,069 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2018-06-27 18:05:21,070 - Group['livy'] {} 2018-06-27 18:05:21,072 - Adding group Group['livy'] 2018-06-27 18:05:21,094 - Group['spark'] {} 2018-06-27 18:05:21,094 - Adding group Group['spark'] 2018-06-27 18:05:21,109 - Group['hdfs'] {} 2018-06-27 18:05:21,109 - Adding group Group['hdfs'] 2018-06-27 18:05:21,124 - Group['hadoop'] {} 2018-06-27 18:05:21,124 - Adding group Group['hadoop'] 2018-06-27 18:05:21,138 - Group['users'] {} 2018-06-27 18:05:21,139 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,139 - Adding user User['hive'] 2018-06-27 18:05:21,169 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,170 - Adding user User['zookeeper'] 2018-06-27 18:05:21,193 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,193 - Adding user User['infra-solr'] 2018-06-27 18:05:21,215 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-06-27 18:05:21,216 - Adding user User['oozie'] 2018-06-27 18:05:21,238 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,238 - Adding user User['ams'] 2018-06-27 18:05:21,262 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-06-27 18:05:21,262 - Adding user User['tez'] 2018-06-27 18:05:21,285 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,285 - Adding user User['livy'] 2018-06-27 18:05:21,309 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,309 - Adding user User['spark'] 2018-06-27 18:05:21,333 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-06-27 18:05:21,333 - Adding user User['ambari-qa'] 2018-06-27 18:05:21,365 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,365 - Adding user User['kafka'] 2018-06-27 18:05:21,389 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs'], 'uid': None} 2018-06-27 18:05:21,389 - Adding user User['hdfs'] 2018-06-27 18:05:21,412 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,412 - Adding user User['sqoop'] 2018-06-27 18:05:21,435 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,435 - Adding user User['yarn'] 2018-06-27 18:05:21,457 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,458 - Adding user User['mapred'] 2018-06-27 18:05:21,481 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-06-27 18:05:21,481 - Adding user User['hcat'] 2018-06-27 18:05:21,505 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-06-27 18:05:21,509 - Writing File['/var/lib/ambari-agent/tmp/changeUid.sh'] because it doesn't exist 2018-06-27 18:05:21,509 - Changing permission for /var/lib/ambari-agent/tmp/changeUid.sh from 644 to 555 2018-06-27 18:05:21,510 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2018-06-27 18:05:21,514 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if 2018-06-27 18:05:21,515 - Group['hdfs'] {} 2018-06-27 18:05:21,515 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', u'hdfs']} 2018-06-27 18:05:21,515 - FS Type: 2018-06-27 18:05:21,516 - Directory['/etc/hadoop'] {'mode': 0755} 2018-06-27 18:05:21,516 - Creating directory Directory['/etc/hadoop'] since it doesn't exist. 2018-06-27 18:05:21,516 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777} 2018-06-27 18:05:21,516 - Creating directory Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] since it doesn't exist. 2018-06-27 18:05:21,517 - Changing owner for /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir from 0 to hdfs 2018-06-27 18:05:21,517 - Changing group for /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir from 0 to hadoop 2018-06-27 18:05:21,517 - Changing permission for /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir from 755 to 1777 2018-06-27 18:05:21,517 - Directory['/var/lib/ambari-agent/tmp/AMBARI-artifacts/'] {'create_parents': True} 2018-06-27 18:05:21,517 - Creating directory Directory['/var/lib/ambari-agent/tmp/AMBARI-artifacts/'] since it doesn't exist. 2018-06-27 18:05:21,518 - File['/var/lib/ambari-agent/tmp/jdk-8u112-linux-x64.tar.gz'] {'content': DownloadSource('http://ip-172-31-7-134.us-east-2.compute.internal:8080/resources/jdk-8u112-linux-x64.tar.gz'), 'not_if': 'test -f /var/lib/ambari-agent/tmp/jdk-8u112-linux-x64.tar.gz'} 2018-06-27 18:05:21,520 - Downloading the file from http://ip-172-31-7-134.us-east-2.compute.internal:8080/resources/jdk-8u112-linux-x64.tar.gz 2018-06-27 18:05:23,877 - File['/var/lib/ambari-agent/tmp/jdk-8u112-linux-x64.tar.gz'] {'mode': 0755} 2018-06-27 18:05:23,877 - Changing permission for /var/lib/ambari-agent/tmp/jdk-8u112-linux-x64.tar.gz from 644 to 755 2018-06-27 18:05:23,878 - Directory['/usr/jdk64'] {} 2018-06-27 18:05:23,878 - Creating directory Directory['/usr/jdk64'] since it doesn't exist. 2018-06-27 18:05:23,878 - Execute[('chmod', 'a+x', u'/usr/jdk64')] {'sudo': True} 2018-06-27 18:05:23,884 - Execute['cd /var/lib/ambari-agent/tmp/jdk_tmp_LrBHXG && tar -xf /var/lib/ambari-agent/tmp/jdk-8u112-linux-x64.tar.gz && ambari-sudo.sh cp -rp /var/lib/ambari-agent/tmp/jdk_tmp_LrBHXG/* /usr/jdk64'] {} 2018-06-27 18:05:27,401 - Directory['/var/lib/ambari-agent/tmp/jdk_tmp_LrBHXG'] {'action': ['delete']} 2018-06-27 18:05:27,402 - Removing directory Directory['/var/lib/ambari-agent/tmp/jdk_tmp_LrBHXG'] and all its content 2018-06-27 18:05:28,056 - File['/usr/jdk64/jdk1.8.0_112/bin/java'] {'mode': 0755, 'cd_access': 'a'} 2018-06-27 18:05:28,057 - Execute[('chmod', '-R', '755', u'/usr/jdk64/jdk1.8.0_112')] {'sudo': True} 2018-06-27 18:05:28,088 - Repository['HDP-2.6-repo-1'] {'append_to_file': False, 'base_url': 'http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.0', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2018-06-27 18:05:28,096 - File['/etc/yum.repos.d/ambari-hdp-1.repo'] {'content': InlineTemplate(...)} 2018-06-27 18:05:28,096 - Writing File['/etc/yum.repos.d/ambari-hdp-1.repo'] because it doesn't exist 2018-06-27 18:05:28,097 - Repository['HDP-2.6-GPL-repo-1'] {'append_to_file': True, 'base_url': 'http://public-repo-1.hortonworks.com/HDP-GPL/centos7/2.x/updates/2.6.5.0', 'action': ['create'], 'components': [u'HDP-GPL', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2018-06-27 18:05:28,100 - File['/etc/yum.repos.d/ambari-hdp-1.repo'] {'content': '[HDP-2.6-repo-1]\nname=HDP-2.6-repo-1\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.0\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-2.6-GPL-repo-1]\nname=HDP-2.6-GPL-repo-1\nbaseurl=http://public-repo-1.hortonworks.com/HDP-GPL/centos7/2.x/updates/2.6.5.0\n\npath=/\nenabled=1\ngpgcheck=0'} 2018-06-27 18:05:28,100 - Writing File['/etc/yum.repos.d/ambari-hdp-1.repo'] because contents don't match 2018-06-27 18:05:28,100 - Repository['HDP-UTILS-1.1.0.22-repo-1'] {'append_to_file': True, 'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2018-06-27 18:05:28,103 - File['/etc/yum.repos.d/ambari-hdp-1.repo'] {'content': '[HDP-2.6-repo-1]\nname=HDP-2.6-repo-1\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.0\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-2.6-GPL-repo-1]\nname=HDP-2.6-GPL-repo-1\nbaseurl=http://public-repo-1.hortonworks.com/HDP-GPL/centos7/2.x/updates/2.6.5.0\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.22-repo-1]\nname=HDP-UTILS-1.1.0.22-repo-1\nbaseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7\n\npath=/\nenabled=1\ngpgcheck=0'} 2018-06-27 18:05:28,103 - Writing File['/etc/yum.repos.d/ambari-hdp-1.repo'] because contents don't match 2018-06-27 18:05:28,104 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2018-06-27 18:05:28,239 - Installing package unzip ('/usr/bin/yum -d 0 -e 0 -y install unzip') 2018-06-27 18:05:30,059 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2018-06-27 18:05:30,095 - Skipping installation of existing package curl 2018-06-27 18:05:30,096 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2018-06-27 18:05:30,130 - Installing package hdp-select ('/usr/bin/yum -d 0 -e 0 -y install hdp-select') 2018-06-27 18:05:31,377 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {} 2018-06-27 18:05:31,400 - call returned (1, 'Traceback (most recent call last):\n File "/usr/bin/hdp-select", line 446, in <module>\n printVersions()\n File "/usr/bin/hdp-select", line 286, in printVersions\n for f in os.listdir(root):\nOSError: [Errno 2] No such file or directory: \'/usr/hdp\'') 2018-06-27 18:05:31,615 - Command repositories: HDP-2.6-repo-1, HDP-2.6-GPL-repo-1, HDP-UTILS-1.1.0.22-repo-1 2018-06-27 18:05:31,615 - Applicable repositories: HDP-2.6-repo-1, HDP-2.6-GPL-repo-1, HDP-UTILS-1.1.0.22-repo-1 2018-06-27 18:05:31,617 - Looking for matching packages in the following repositories: HDP-2.6-repo-1, HDP-2.6-GPL-repo-1, HDP-UTILS-1.1.0.22-repo-1 2018-06-27 18:05:34,280 - Package['hadoop_2_6_5_0_292-yarn'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2018-06-27 18:05:34,412 - Installing package hadoop_2_6_5_0_292-yarn ('/usr/bin/yum -d 0 -e 0 -y install hadoop_2_6_5_0_292-yarn') 2018-06-27 18:06:05,163 - Package['hadoop_2_6_5_0_292-mapreduce'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2018-06-27 18:06:05,201 - Installing package hadoop_2_6_5_0_292-mapreduce ('/usr/bin/yum -d 0 -e 0 -y install hadoop_2_6_5_0_292-mapreduce') 2018-06-27 18:06:06,663 - Execution of '/usr/bin/yum -d 0 -e 0 -y install hadoop_2_6_5_0_292-mapreduce' returned 1. Error: Package: hadoop_2_6_5_0_292-hdfs-2.7.3.2.6.5.0-292.x86_64 (HDP-2.6-repo-1) Requires: libtirpc-devel You could try using --skip-broken to work around the problem You could try running: rpm -Va --nofiles --nodigest 2018-06-27 18:06:06,663 - Failed to install package hadoop_2_6_5_0_292-mapreduce. Executing '/usr/bin/yum clean metadata' 2018-06-27 18:06:06,910 - Retrying to install package hadoop_2_6_5_0_292-mapreduce after 30 seconds ... View more
Labels:

Re: NodeManager is failing soon after restart

by Rising Star in Support Questions
‎06-26-2018 08:34 PM
‎06-26-2018 08:34 PM
@Jay Kumar SenSharma - here is the log. When I restart it it stays up for sometime before going down. [root@D02 yarn]# tail -10 yarn-yarn-nodemanager-D02.asotc.com.log 2018-06-26 16:15:09,830 INFO shuffle.ExternalShuffleBlockResolver (ExternalShuffleBlockResolver.java:application) - Application application_1527390036186_1818 removed, cleanupLocalDirs = false 2018-06-26 16:15:09,854 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application applic0036186_1818 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED 2018-06-26 16:15:09,854 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:finishLogAggregationlication just finished : application_1527390036186_1818 2018-06-26 16:15:10,267 INFO zlib.ZlibFactory (ZlibFactory.java:<clinit>(49)) - Successfully loaded & initializeb library 2018-06-26 16:15:10,356 INFO ipc.Server (Server.java:saslProcess(1441)) - Auth successful for appattempt_1527390000001 (auth:SIMPLE) 2018-06-26 16:15:10,377 INFO compress.CodecPool (CodecPool.java:getCompressor(153)) - Got brand-new compressor [ 2018-06-26 16:15:10,391 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggreg- Uploading logs for container container_e297_1527390036186_1818_03_000001. Current good log dirs are /data/hadoo 2018-06-26 16:15:10,454 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInte Start request for container_e297_1527390036186_1825_01_000001 by user dr.who 2018-06-26 16:15:10,455 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInte Creating a new application reference for app application_1527390036186_1825 2018-06-26 16:15:10,473 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application applic0036186_1825 transitioned from NEW to INITING 2018-06-26 16:15:10,485 WARN logaggregation.LogAggregationService (LogAggregationService.java:verifyAndCreateRem5)) - Remote Root Log Dir [/app-logs] already exist, but with incorrect permissions. Expected: [rwxrwxrwt], Found]. The cluster may have problems with multiple users. 2018-06-26 16:15:10,486 WARN logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:<init>(190)) - rollierval is set as -1. The log rolling mornitoring interval is disabled. The logs will be aggregated after this applinished. 2018-06-26 16:15:10,557 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=dr.who I0 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application86_1825 CONTAINERID=container_e297_1527390036186_1825_01_000001 2018-06-26 16:15:10,574 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(46ng path : /data/hadoop/yarn/log/application_1527390036186_1818/container_e297_1527390036186_1818_03_000001/launchh 2018-06-26 16:15:10,575 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(46ng path : /data/hadoop/yarn/log/application_1527390036186_1818/container_e297_1527390036186_1818_03_000001/direct 2018-06-26 16:15:10,679 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding contain390036186_1825_01_000001 to application application_1527390036186_1825 2018-06-26 16:15:10,680 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application applic0036186_1825 transitioned from INITING to RUNNING 2018-06-26 16:15:10,680 INFO container.ContainerImpl (ContainerImpl.java:handle(1136)) - Container container_e29186_1825_01_000001 transitioned from NEW to LOCALIZED 2018-06-26 16:15:10,680 INFO containermanager.AuxServices (AuxServices.java:handle(196)) - Got event CONTAINER_Id application_1527390036186_1825 2018-06-26 16:15:10,680 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(183)) - Initiainer container_e297_1527390036186_1825_01_000001 2018-06-26 16:15:10,902 INFO container.ContainerImpl (ContainerImpl.java:handle(1136)) - Container container_e29186_1825_01_000001 transitioned from LOCALIZED to RUNNING 2018-06-26 16:15:10,910 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExe- launchContainer: [bash, /data/hadoop/yarn/local/usercache/dr.who/appcache/application_1527390036186_1825/contai7390036186_1825_01_000001/default_container_executor.sh] ... View more

NodeManager is failing soon after restart

by Rising Star in Support Questions
‎06-15-2018 02:03 AM
‎06-15-2018 02:03 AM
I have 3 node manager in my cluster and they are failing soon after restart.. I tried deleting /var/log/hadoop-yarn/nodemanager/recovery-state directory but no help... Please help. Where can I find the log to see why is this failing... ... View more
Labels:

Hearbeat lost

by Rising Star in Support Questions
‎06-04-2018 02:06 AM
‎06-04-2018 02:06 AM
All of a sudden all my cluster machines lost the hearbeat. What could be wro INFO 2018-06-03 06:14:50,210 NetUtil.py:70 - Connecting to https://localhost:8440/connection_info INFO 2018-06-03 06:14:50,351 security.py:55 - Server require two-way SSL authentication. Use it instead of one-way... INFO 2018-06-03 06:14:50,352 security.py:182 - Server certicate exists, ok INFO 2018-06-03 06:14:50,352 security.py:190 - Agent key exists, ok INFO 2018-06-03 06:14:50,352 security.py:198 - Agent certificate exists, ok INFO 2018-06-03 06:14:50,353 security.py:93 - SSL Connect being called.. connecting to the server ERROR 2018-06-03 06:14:50,361 security.py:80 - Two-way SSL authentication failed. Ensure that server and agent certificates were signed by the same CA and restart the agent. In order to receive a new agent certificate, remove existing certificate file from keys directory. As a workaround you can turn off two-way SSL authentication in server configuration(ambari.properties) Exiting.. ... View more
Labels:

Re: New host registration failing on SUSE Linux 11

by Rising Star in Support Questions
‎05-04-2018 02:40 PM
‎05-04-2018 02:40 PM
INFO 2018-05-04 10:36:31,383 NetUtil.py:70 - Connecting to https://ambari.asotc.com:8440/ca WARNING 2018-05-04 10:36:31,384 NetUtil.py:101 - Failed to connect to https://ambari.asotc.com:8440/ca due to 'module' object has no attribute 'PROTOCOL_TLSv1_2' WARNING 2018-05-04 10:36:31,384 NetUtil.py:124 - Server at https://ambari.asotc.com:8440 is not reachable, sleeping for 10 seconds... INFO 2018-05-04 10:36:41,384 NetUtil.py:70 - Connecting to https://ambari.asotc.com:8440/ca WARNING 2018-05-04 10:36:41,385 NetUtil.py:101 - Failed to connect to https://ambari.asotc.com:8440/ca due to 'module' object has no attribute 'PROTOCOL_TLSv1_2' WARNING 2018-05-04 10:36:41,386 NetUtil.py:124 - Server at https://ambari.asotc.com:8440 is not reachable, sleeping for 10 seconds... INFO 2018-05-04 10:36:51,386 NetUtil.py:70 - Connecting to https://ambari.asotc.com:8440/ca WARNING 2018-05-04 10:36:51,387 NetUtil.py:101 - Failed to connect to https://ambari.asotc.com:8440/ca due to 'module' object has no attribute 'PROTOCOL_TLSv1_2' WARNING 2018-05-04 10:36:51,388 NetUtil.py:124 - Server at https://ambari.asotc.com:8440 is not reachable, sleeping for 10 seconds... INFO 2018-05-04 10:37:01,388 NetUtil.py:70 - Connecting to https://ambari.asotc.com:8440/ca WARNING 2018-05-04 10:37:01,389 NetUtil.py:101 - Failed to connect to https://ambari.asotc.com:8440/ca due to 'module' object has no attribute 'PROTOCOL_TLSv1_2' WARNING 2018-05-04 10:37:01,390 NetUtil.py:124 - Server at https://ambari.asotc.com:8440 is not reachable, sleeping for 10 seconds... INFO 2018-05-04 10:37:11,390 NetUtil.py:70 - Connecting to https://ambari.asotc.com:8440/ca WARNING 2018-05-04 10:37:11,391 NetUtil.py:101 - Failed to connect to https://ambari.asotc.com:8440/ca due to 'module' object has no attribute 'PROTOCOL_TLSv1_2' WARNING 2018-05-04 10:37:11,392 NetUtil.py:124 - Server at https://ambari.asotc.com:8440 is not reachable, sleeping for 10 seconds... INFO 2018-05-04 10:37:21,392 NetUtil.py:70 - Connecting to https://ambari.asotc.com:8440/ca WARNING 2018-05-04 10:37:21,393 NetUtil.py:101 - Failed to connect to https://ambari.asotc.com:8440/ca due to 'module' object has no attribute 'PROTOCOL_TLSv1_2' WARNING 2018-05-04 10:37:21,394 NetUtil.py:124 - Server at https://ambari.asotc.com:8440 is not reachable, sleeping for 10 seconds... INFO 2018-05-04 10:37:31,394 NetUtil.py:70 - Connecting to https://ambari.asotc.com:8440/ca WARNING 2018-05-04 10:37:31,395 NetUtil.py:101 - Failed to connect to https://ambari.asotc.com:8440/ca due to 'module' object has no attribute 'PROTOCOL_TLSv1_2' WARNING 2018-05-04 10:37:31,396 NetUtil.py:124 - Server at https://ambari.asotc.com:8440 is not reachable, sleeping for 10 seconds... ... View more

Re: New host registration failing on SUSE Linux 11

by Rising Star in Support Questions
‎05-04-2018 02:36 PM
‎05-04-2018 02:36 PM
@Jay Kumar SenSharma Please find below ambari-agent INI and versio # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific [server] hostname=ambari.asotc.com url_port=8440 secured_url_port=8441 connect_retry_delay=10 max_reconnect_retry_delay=30 [agent] logdir=/var/log/ambari-agent piddir=/var/run/ambari-agent prefix=/var/lib/ambari-agent/data ;loglevel=(DEBUG/INFO) loglevel=DEBUG data_cleanup_interval=86400 data_cleanup_max_age=2592000 data_cleanup_max_size_MB = 100 ping_port=8670 cache_dir=/var/lib/ambari-agent/cache tolerate_download_failures=true run_as_user=root parallel_execution=0 alert_grace_period=5 status_command_timeout=5 alert_kinit_timeout=14400000 system_resource_overrides=/etc/resource_overrides ; memory_threshold_soft_mb=400 ; memory_threshold_hard_mb=1000 ; ignore_mount_points=/mnt/custom1,/mnt/custom2 [security] force_https_protocol=PROTOCOL_TLSv1_2 keysdir=/var/lib/ambari-agent/keys server_crt=ca.crt passphrase_env_var_name=AMBARI_PASSPHRASE ssl_verify_cert=0 credential_lib_dir=/var/lib/ambari-agent/cred/lib credential_conf_dir=/var/lib/ambari-agent/cred/conf credential_shell_cmd=org.apache.hadoop.security.alias.CredentialShell [n_protocol=PROTOCOL_TLSv1_2twork] [services] pidLookupPath=/var/run/ [heartbeat] state_interval_seconds=60 dirs=/etc/hadoop,/etc/hadoop/conf,/etc/hbase,/etc/hcatalog,/etc/hive,/etc/oozie, /etc/sqoop, /var/run/hadoop,/var/run/zookeeper,/var/run/hbase,/var/run/templeton,/var/run/oozie, /var/log/hadoop,/var/log/zookeeper,/var/log/hbase,/var/run/templeton,/var/log/hive ; 0 - unlimited log_lines_count=300 idle_interval_min=1 idle_interval_max=10 [logging] syslog_enabled=0 vds:~ # ambari-agent --version 2.5.1.0 ... View more

Authentication and Authorization question

by Rising Star in Support Questions
‎05-02-2018 08:59 PM
‎05-02-2018 08:59 PM
Hi ! Experts. I am working on a POC for SAP-->Hadoop integration prototype. Basically looking into moving data off of SAP and store into Hadoop. BODS is being used for this purpose. Setup: HIVESERVER2 is setup for "NO Authentication" ODBC connection is used to connect to HIVE Warehouse Connection is successful BODS configuration is looking for HDFS directory which I have created Question: When BODS/Job server copies data to hadoop/hive, does it create tables by default. I assume since hiveserver2 is setup as no authentication, BODS will be able to create tables without any authorization What's the purpose of HDFS directory. I created a folder inside HDFS and made it "777" so that anyone create files in it. Thanks ... View more
Labels:

New host registration failing on SUSE Linux 11

by Rising Star in Support Questions
‎05-02-2018 02:38 PM
‎05-02-2018 02:38 PM
@Jay Kumar SenSharma Trying to register another host ( SUSE LINUX 11, SP4) and getting the following error. OS: SUSE LINUX 11, SP4 Python: 2.6.9 AMbari-Agent: 2.5.1 WARNING 2018-05-02 10:30:45,836 NetUtil.py:101 - Failed to connect to https://ambari.asotc.com:8440/ca due to 'module' object has no attribute 'PROTOCOL_TLSv1_2' ... View more
Labels:

Re: registering a new SUSE LINUX host is failing

by Rising Star in Support Questions
‎04-24-2018 04:26 PM
‎04-24-2018 04:26 PM
@Jay Kumar SenSharma Thank you. Not sure why is this setup like that. security.server.two_way_ssl = true I disabled it and restarted ambari-server. On the host machine I added property "force_https_protocol=PROTOCOL_TLSv1_2" and then I tried registering again BUT this time it did recognized and started registering but then in the review process I got the error below and registration process is stuck at "PREPARING TO DEPLOY: 14 of 14 task COMPLETED" Should I re-image the machine to SUSE LINUX 12 SP1 or SP2 ( per document HDP only supports till SP2) An internal system exception occurred: Trying to map host to cluster where stack does not support host's os type, clusterName=hadoop, clusterStackId=HDP-2.4, hostname=ds.asotc.com, hostOsFamily=suse12 ... View more

Re: registering a new SUSE LINUX host is failing

by Rising Star in Support Questions
‎04-24-2018 02:57 PM
‎04-24-2018 02:57 PM
@Jay Kumar SenSharma Looks like it got updated now ds:/var/log/ambari-agent # tail -50 /var/log/ambari-agent/ambari-agent.log INFO 2018-04-24 10:55:27,940 security.py:55 - Server require two-way SSL authentication. Use it instead of one-way... INFO 2018-04-24 10:55:27,941 security.py:179 - Server certicate not exists, downloading INFO 2018-04-24 10:55:27,941 security.py:202 - Downloading server cert from https://ambari.asotc.com:8440/cert/ca/ ERROR 2018-04-24 10:55:27,949 Controller.py:226 - Unable to connect to: https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/ambari_agent/Controller.py", line 175, in registerWithServer ret = self.sendRequest(self.registerUrl, data) File "/usr/lib/python2.6/site-packages/ambari_agent/Controller.py", line 545, in sendRequest raise IOError('Request to {0} failed due to {1}'.format(url, str(exception))) IOError: Request to https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com failed due to <urlopen error EOF occurred in violation of protocol (_ssl.c:661)> ERROR 2018-04-24 10:55:27,949 Controller.py:227 - Error:Request to https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com failed due to <urlopen error EOF occurred in violation of protocol (_ssl.c:661)> WARNING 2018-04-24 10:55:27,949 Controller.py:228 - Sleeping for 26 seconds and then trying again DEBUG 2018-04-24 10:55:54,143 HostCheckReportFileHandler.py:126 - Host check report at /var/lib/ambari-agent/data/hostcheck.result DEBUG 2018-04-24 10:55:54,144 HostCheckReportFileHandler.py:177 - Removing old host check file at /var/lib/ambari-agent/data/hostcheck.result DEBUG 2018-04-24 10:55:54,145 HostCheckReportFileHandler.py:182 - Creating host check file at /var/lib/ambari-agent/data/hostcheck.result INFO 2018-04-24 10:55:54,158 Controller.py:170 - Registering with ds.asotc.com (172.16.1.67) (agent='{"hardwareProfile": {"kernel": "Linux", "domain": "asotc.com", "physicalprocessorcount": 1, "kernelrelease": "4.4.73-7-default", "uptime_days": "0", "memorytotal": 8068504, "swapfree": "2.00 GB", "memorysize": 8068504, "osfamily": "suse", "swapsize": "2.00 GB", "processorcount": 1, "netmask": "255.255.255.0", "timezone": "EST", "hardwareisa": "x86_64", "memoryfree": 6838720, "operatingsystem": "sles", "kernelmajversion": "4.4", "kernelversion": "4.4.73", "macaddress": "00:15:5D:01:C8:19", "operatingsystemrelease": "12", "ipaddress": "172.16.1.67", "hostname": "ds", "uptime_hours": "1", "fqdn": "ds.asotc.com", "id": "root", "architecture": "x86_64", "selinux": false, "mounts": [{"available": "4023372", "used": "0", "percent": "0%", "device": "devtmpfs", "mountpoint": "/dev", "type": "devtmpfs", "size": "4023372"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/.snapshots", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/tmp", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/home", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/mysql", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/boot/grub2/x86_64-efi", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/opt", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/tmp", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/srv", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/spool", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/usr/local", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/libvirt/images", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/mailman", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/machines", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/log", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/crash", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/pgsql", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/boot/grub2/i386-pc", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/mariadb", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/named", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/opt", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/cache", "type": "btrfs", "size": "62914560"}], "hardwaremodel": "x86_64", "uptime_seconds": "6573", "interfaces": "eth0,lo"}, "currentPingPort": 8670, "prefix": "/var/lib/ambari-agent/data", "agentVersion": "2.5.1.0", "agentEnv": {"transparentHugePage": "", "hostHealth": {"agentTimeStampAtReporting": 1524581754145, "activeJavaProcs": [], "liveServices": [{"status": "Healthy", "name": "ntpd or ntp", "desc": ""}]}, "reverseLookup": true, "alternatives": [], "hasUnlimitedJcePolicy": null, "umask": "18", "firewallName": "rcSuSEfirewall2", "stackFoldersAndFiles": [], "existingUsers": [], "firewallRunning": false}, "timestamp": 1524581753950, "hostname": "ds.asotc.com", "responseId": -1, "publicHostname": "ds.asotc.com"}') INFO 2018-04-24 10:55:54,162 NetUtil.py:70 - Connecting to https://ambari.asotc.com:8440/connection_info DEBUG 2018-04-24 10:55:54,335 NetUtil.py:90 - GET https://ambari.asotc.com:8440/connection_info -> 200, body: {"security.server.two_way_ssl":"true"} DEBUG 2018-04-24 10:55:54,336 security.py:52 - Server two-way SSL authentication required: True INFO 2018-04-24 10:55:54,336 security.py:55 - Server require two-way SSL authentication. Use it instead of one-way... INFO 2018-04-24 10:55:54,337 security.py:179 - Server certicate not exists, downloading INFO 2018-04-24 10:55:54,337 security.py:202 - Downloading server cert from https://ambari.asotc.com:8440/cert/ca/ ERROR 2018-04-24 10:55:54,345 Controller.py:226 - Unable to connect to: https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/ambari_agent/Controller.py", line 175, in registerWithServer ret = self.sendRequest(self.registerUrl, data) File "/usr/lib/python2.6/site-packages/ambari_agent/Controller.py", line 545, in sendRequest raise IOError('Request to {0} failed due to {1}'.format(url, str(exception))) IOError: Request to https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com failed due to <urlopen error EOF occurred in violation of protocol (_ssl.c:661)> ERROR 2018-04-24 10:55:54,345 Controller.py:227 - Error:Request to https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com failed due to <urlopen error EOF occurred in violation of protocol (_ssl.c:661)> WARNING 2018-04-24 10:55:54,345 Controller.py:228 - Sleeping for 25 seconds and then trying again DEBUG 2018-04-24 10:56:19,552 HostCheckReportFileHandler.py:126 - Host check report at /var/lib/ambari-agent/data/hostcheck.result DEBUG 2018-04-24 10:56:19,553 HostCheckReportFileHandler.py:177 - Removing old host check file at /var/lib/ambari-agent/data/hostcheck.result DEBUG 2018-04-24 10:56:19,553 HostCheckReportFileHandler.py:182 - Creating host check file at /var/lib/ambari-agent/data/hostcheck.result INFO 2018-04-24 10:56:19,558 Controller.py:170 - Registering with ds.asotc.com (172.16.1.67) (agent='{"hardwareProfile": {"kernel": "Linux", "domain": "asotc.com", "physicalprocessorcount": 1, "kernelrelease": "4.4.73-7-default", "uptime_days": "0", "memorytotal": 8068504, "swapfree": "2.00 GB", "memorysize": 8068504, "osfamily": "suse", "swapsize": "2.00 GB", "processorcount": 1, "netmask": "255.255.255.0", "timezone": "EST", "hardwareisa": "x86_64", "memoryfree": 6838720, "operatingsystem": "sles", "kernelmajversion": "4.4", "kernelversion": "4.4.73", "macaddress": "00:15:5D:01:C8:19", "operatingsystemrelease": "12", "ipaddress": "172.16.1.67", "hostname": "ds", "uptime_hours": "1", "fqdn": "ds.asotc.com", "id": "root", "architecture": "x86_64", "selinux": false, "mounts": [{"available": "4023372", "used": "0", "percent": "0%", "device": "devtmpfs", "mountpoint": "/dev", "type": "devtmpfs", "size": "4023372"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/.snapshots", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/tmp", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/home", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/mysql", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/boot/grub2/x86_64-efi", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/opt", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/tmp", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/srv", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/spool", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/usr/local", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/libvirt/images", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/mailman", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/machines", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/log", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/crash", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/pgsql", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/boot/grub2/i386-pc", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/mariadb", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/lib/named", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/opt", "type": "btrfs", "size": "62914560"}, {"available": "55906100", "used": "5387708", "percent": "9%", "device": "/dev/mapper/system-root", "mountpoint": "/var/cache", "type": "btrfs", "size": "62914560"}], "hardwaremodel": "x86_64", "uptime_seconds": "6573", "interfaces": "eth0,lo"}, "currentPingPort": 8670, "prefix": "/var/lib/ambari-agent/data", "agentVersion": "2.5.1.0", "agentEnv": {"transparentHugePage": "", "hostHealth": {"agentTimeStampAtReporting": 1524581779553, "activeJavaProcs": [], "liveServices": [{"status": "Healthy", "name": "ntpd or ntp", "desc": ""}]}, "reverseLookup": true, "alternatives": [], "hasUnlimitedJcePolicy": null, "umask": "18", "firewallName": "rcSuSEfirewall2", "stackFoldersAndFiles": [], "existingUsers": [], "firewallRunning": false}, "timestamp": 1524581779358, "hostname": "ds.asotc.com", "responseId": -1, "publicHostname": "ds.asotc.com"}') INFO 2018-04-24 10:56:19,561 NetUtil.py:70 - Connecting to https://ambari.asotc.com:8440/connection_info DEBUG 2018-04-24 10:56:19,683 NetUtil.py:90 - GET https://ambari.asotc.com:8440/connection_info -> 200, body: {"security.server.two_way_ssl":"true"} DEBUG 2018-04-24 10:56:19,684 security.py:52 - Server two-way SSL authentication required: True INFO 2018-04-24 10:56:19,684 security.py:55 - Server require two-way SSL authentication. Use it instead of one-way... INFO 2018-04-24 10:56:19,684 security.py:179 - Server certicate not exists, downloading INFO 2018-04-24 10:56:19,684 security.py:202 - Downloading server cert from https://ambari.asotc.com:8440/cert/ca/ ERROR 2018-04-24 10:56:19,693 Controller.py:226 - Unable to connect to: https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/ambari_agent/Controller.py", line 175, in registerWithServer ret = self.sendRequest(self.registerUrl, data) File "/usr/lib/python2.6/site-packages/ambari_agent/Controller.py", line 545, in sendRequest raise IOError('Request to {0} failed due to {1}'.format(url, str(exception))) IOError: Request to https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com failed due to <urlopen error EOF occurred in violation of protocol (_ssl.c:661)> ERROR 2018-04-24 10:56:19,693 Controller.py:227 - Error:Request to https://ambari.asotc.com:8441/agent/v1/register/ds.asotc.com failed due to <urlopen error EOF occurred in violation of protocol (_ssl.c:661)> WARNING 2018-04-24 10:56:19,694 Controller.py:228 - Sleeping for 28 seconds and then trying again ... View more
Contact Me
Online
Offline
Last Visited
‎03-20-2020 09:39 PM
Public Statistics
Date Registered ‎12-11-2015 04:02 AM
Last Visited ‎03-20-2020 09:39 PM
Total Messages Posted 213
Total Kudos Received 87