stderr: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_server.py", line 143, in HiveServer().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 351, in execute method(env) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_server.py", line 53, in start hive_service('hiveserver2', action = 'start', upgrade_type=upgrade_type) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_service.py", line 101, in hive_service wait_for_znode() File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/decorator.py", line 54, in wrapper return function(*args, **kwargs) File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/scripts/hive_service.py", line 184, in wait_for_znode raise Exception(format("HiveServer2 is no longer running, check the logs at {hive_log_dir}")) Exception: HiveServer2 is no longer running, check the logs at /var/log/hive stdout: 2018-11-22 12:08:56,374 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:08:56,388 - Using hadoop conf dir: /usr/hdp/3.0.1.0-187/hadoop/conf 2018-11-22 12:08:56,502 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:08:56,506 - Using hadoop conf dir: /usr/hdp/3.0.1.0-187/hadoop/conf 2018-11-22 12:08:56,507 - Group['hdfs'] {} 2018-11-22 12:08:56,508 - Group['hadoop'] {} 2018-11-22 12:08:56,508 - Group['users'] {} 2018-11-22 12:08:56,508 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-11-22 12:08:56,509 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-11-22 12:08:56,510 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-11-22 12:08:56,510 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-11-22 12:08:56,511 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None} 2018-11-22 12:08:56,511 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None} 2018-11-22 12:08:56,512 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None} 2018-11-22 12:08:56,512 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid': None} 2018-11-22 12:08:56,513 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-11-22 12:08:56,513 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-11-22 12:08:56,514 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-11-22 12:08:56,514 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-11-22 12:08:56,516 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2018-11-22 12:08:56,519 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if 2018-11-22 12:08:56,519 - Group['hdfs'] {} 2018-11-22 12:08:56,520 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop', u'hdfs']} 2018-11-22 12:08:56,520 - FS Type: HDFS 2018-11-22 12:08:56,520 - Directory['/etc/hadoop'] {'mode': 0755} 2018-11-22 12:08:56,530 - File['/usr/hdp/3.0.1.0-187/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} 2018-11-22 12:08:56,531 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777} 2018-11-22 12:08:56,541 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'} 2018-11-22 12:08:56,546 - Skipping Execute[('setenforce', '0')] due to not_if 2018-11-22 12:08:56,546 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'} 2018-11-22 12:08:56,548 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'} 2018-11-22 12:08:56,548 - Directory['/var/run/hadoop/hdfs'] {'owner': 'hdfs', 'cd_access': 'a'} 2018-11-22 12:08:56,548 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'} 2018-11-22 12:08:56,551 - File['/usr/hdp/3.0.1.0-187/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'} 2018-11-22 12:08:56,552 - File['/usr/hdp/3.0.1.0-187/hadoop/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'} 2018-11-22 12:08:56,556 - File['/usr/hdp/3.0.1.0-187/hadoop/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:56,563 - File['/usr/hdp/3.0.1.0-187/hadoop/conf/hadoop-metrics2.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} 2018-11-22 12:08:56,564 - File['/usr/hdp/3.0.1.0-187/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755} 2018-11-22 12:08:56,565 - File['/usr/hdp/3.0.1.0-187/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'} 2018-11-22 12:08:56,568 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:56,570 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755} 2018-11-22 12:08:56,573 - Skipping unlimited key JCE policy check and setup since the Java VM is not managed by Ambari 2018-11-22 12:08:56,760 - Using hadoop conf dir: /usr/hdp/3.0.1.0-187/hadoop/conf 2018-11-22 12:08:56,768 - call['ambari-python-wrap /usr/bin/hdp-select status hive-server2'] {'timeout': 20} 2018-11-22 12:08:56,783 - call returned (0, 'hive-server2 - 3.0.1.0-187') 2018-11-22 12:08:56,784 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:08:56,800 - File['/var/lib/ambari-agent/cred/lib/CredentialUtil.jar'] {'content': DownloadSource('http://hmaster.nic.in:8080/resources/CredentialUtil.jar'), 'mode': 0755} 2018-11-22 12:08:56,801 - Not downloading the file from http://hmaster.nic.in:8080/resources/CredentialUtil.jar, because /var/lib/ambari-agent/tmp/CredentialUtil.jar already exists 2018-11-22 12:08:57,390 - Directories to fill with configs: [u'/usr/hdp/current/hive-server2/conf', u'/usr/hdp/current/hive-server2/conf/'] 2018-11-22 12:08:57,390 - Directory['/etc/hive/3.0.1.0-187/0'] {'owner': 'hive', 'group': 'hadoop', 'create_parents': True, 'mode': 0755} 2018-11-22 12:08:57,391 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hive/3.0.1.0-187/0', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': ...} 2018-11-22 12:08:57,398 - Generating config: /etc/hive/3.0.1.0-187/0/mapred-site.xml 2018-11-22 12:08:57,398 - File['/etc/hive/3.0.1.0-187/0/mapred-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-11-22 12:08:57,427 - File['/etc/hive/3.0.1.0-187/0/hive-default.xml.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,428 - File['/etc/hive/3.0.1.0-187/0/hive-env.sh.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0755} 2018-11-22 12:08:57,430 - File['/etc/hive/3.0.1.0-187/0/llap-daemon-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,432 - File['/etc/hive/3.0.1.0-187/0/llap-cli-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,433 - File['/etc/hive/3.0.1.0-187/0/hive-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,435 - File['/etc/hive/3.0.1.0-187/0/hive-exec-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,436 - File['/etc/hive/3.0.1.0-187/0/beeline-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,436 - XmlConfig['beeline-site.xml'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644, 'conf_dir': '/etc/hive/3.0.1.0-187/0', 'configurations': {'beeline.hs2.jdbc.url.container': u'jdbc:hive2://hdata1.nic.in:2181,hmaster.nic.in:2181,hdata2.nic.in:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2', 'beeline.hs2.jdbc.url.default': 'container'}} 2018-11-22 12:08:57,442 - Generating config: /etc/hive/3.0.1.0-187/0/beeline-site.xml 2018-11-22 12:08:57,442 - File['/etc/hive/3.0.1.0-187/0/beeline-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-11-22 12:08:57,444 - File['/etc/hive/3.0.1.0-187/0/parquet-logging.properties'] {'content': ..., 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,444 - Directory['/etc/hive/3.0.1.0-187/0'] {'owner': 'hive', 'group': 'hadoop', 'create_parents': True, 'mode': 0755} 2018-11-22 12:08:57,445 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hive/3.0.1.0-187/0', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': ...} 2018-11-22 12:08:57,450 - Generating config: /etc/hive/3.0.1.0-187/0/mapred-site.xml 2018-11-22 12:08:57,450 - File['/etc/hive/3.0.1.0-187/0/mapred-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-11-22 12:08:57,478 - File['/etc/hive/3.0.1.0-187/0/hive-default.xml.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,478 - File['/etc/hive/3.0.1.0-187/0/hive-env.sh.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0755} 2018-11-22 12:08:57,481 - File['/etc/hive/3.0.1.0-187/0/llap-daemon-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,482 - File['/etc/hive/3.0.1.0-187/0/llap-cli-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,484 - File['/etc/hive/3.0.1.0-187/0/hive-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,485 - File['/etc/hive/3.0.1.0-187/0/hive-exec-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,487 - File['/etc/hive/3.0.1.0-187/0/beeline-log4j2.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,487 - XmlConfig['beeline-site.xml'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644, 'conf_dir': '/etc/hive/3.0.1.0-187/0', 'configurations': {'beeline.hs2.jdbc.url.container': u'jdbc:hive2://hdata1.nic.in:2181,hmaster.nic.in:2181,hdata2.nic.in:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2', 'beeline.hs2.jdbc.url.default': 'container'}} 2018-11-22 12:08:57,493 - Generating config: /etc/hive/3.0.1.0-187/0/beeline-site.xml 2018-11-22 12:08:57,493 - File['/etc/hive/3.0.1.0-187/0/beeline-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-11-22 12:08:57,495 - File['/etc/hive/3.0.1.0-187/0/parquet-logging.properties'] {'content': ..., 'owner': 'hive', 'group': 'hadoop', 'mode': 0644} 2018-11-22 12:08:57,495 - File['/usr/hdp/current/hive-server2/conf/hive-site.jceks'] {'content': StaticFile('/var/lib/ambari-agent/cred/conf/hive_server/hive-site.jceks'), 'owner': 'hive', 'group': 'hadoop', 'mode': 0640} 2018-11-22 12:08:57,496 - Writing File['/usr/hdp/current/hive-server2/conf/hive-site.jceks'] because contents don't match 2018-11-22 12:08:57,496 - XmlConfig['hive-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hive-server2/conf/', 'mode': 0644, 'configuration_attributes': {u'hidden': {u'javax.jdo.option.ConnectionPassword': u'HIVE_CLIENT,CONFIG_DOWNLOAD'}}, 'owner': 'hive', 'configurations': ...} 2018-11-22 12:08:57,501 - Generating config: /usr/hdp/current/hive-server2/conf/hive-site.xml 2018-11-22 12:08:57,501 - File['/usr/hdp/current/hive-server2/conf/hive-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'} 2018-11-22 12:08:57,602 - File['/usr/hdp/current/hive-server2/conf//hive-env.sh'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0755} 2018-11-22 12:08:57,602 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'} 2018-11-22 12:08:57,604 - File['/etc/security/limits.d/hive.conf'] {'content': Template('hive.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644} 2018-11-22 12:08:57,604 - File['/usr/lib/ambari-agent/DBConnectionVerification.jar'] {'content': DownloadSource('http://hmaster.nic.in:8080/resources/DBConnectionVerification.jar'), 'mode': 0644} 2018-11-22 12:08:57,605 - Not downloading the file from http://hmaster.nic.in:8080/resources/DBConnectionVerification.jar, because /var/lib/ambari-agent/tmp/DBConnectionVerification.jar already exists 2018-11-22 12:08:57,605 - Directory['/var/run/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-11-22 12:08:57,605 - Directory['/var/log/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-11-22 12:08:57,605 - Directory['/var/lib/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'} 2018-11-22 12:08:57,606 - File['/var/lib/ambari-agent/tmp/start_hiveserver2_script'] {'content': Template('startHiveserver2.sh.j2'), 'mode': 0755} 2018-11-22 12:08:57,610 - File['/usr/hdp/current/hive-server2/conf/hadoop-metrics2-hiveserver2.properties'] {'content': Template('hadoop-metrics2-hiveserver2.properties.j2'), 'owner': 'hive', 'group': 'hadoop', 'mode': 0600} 2018-11-22 12:08:57,610 - XmlConfig['hiveserver2-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hive-server2/conf/', 'mode': 0600, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': {u'hive.metastore.metrics.enabled': u'true', u'hive.security.authorization.enabled': u'false', u'hive.service.metrics.reporter': u'HADOOP2', u'hive.service.metrics.hadoop2.component': u'hiveserver2', u'hive.server2.metrics.enabled': u'true'}} 2018-11-22 12:08:57,616 - Generating config: /usr/hdp/current/hive-server2/conf/hiveserver2-site.xml 2018-11-22 12:08:57,616 - File['/usr/hdp/current/hive-server2/conf/hiveserver2-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0600, 'encoding': 'UTF-8'} 2018-11-22 12:08:57,621 - Called copy_to_hdfs tarball: mapreduce 2018-11-22 12:08:57,621 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:08:57,621 - Tarball version was calcuated as 3.0.1.0-187. Use Command Version: True 2018-11-22 12:08:57,621 - Source file: /usr/hdp/3.0.1.0-187/hadoop/mapreduce.tar.gz , Dest file in HDFS: /hdp/apps/3.0.1.0-187/mapreduce/mapreduce.tar.gz 2018-11-22 12:08:57,621 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:08:57,621 - Tarball version was calcuated as 3.0.1.0-187. Use Command Version: True 2018-11-22 12:08:57,621 - HdfsResource['/hdp/apps/3.0.1.0-187/mapreduce'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hdfs', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0555} 2018-11-22 12:08:57,623 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmp1JWkVX 2>/tmp/tmpZwIwPV''] {'quiet': False} 2018-11-22 12:08:57,660 - call returned (0, '') 2018-11-22 12:08:57,660 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "14 62 69 64 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1151,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350810,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367859123,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738279361,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:08:57,661 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpio1j4p 2>/tmp/tmpJDD4b7''] {'quiet': False} 2018-11-22 12:08:57,700 - call returned (0, '') 2018-11-22 12:08:57,700 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1150,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367859123,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738279361,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 111922,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:08:57,701 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:08:57,701 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/hdp/apps/3.0.1.0-187/mapreduce?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpQEJ6yy 2>/tmp/tmpeB1RtK''] {'logoutput': None, 'quiet': False} 2018-11-22 12:08:57,740 - call returned (0, '') 2018-11-22 12:08:57,740 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":16399,"group":"hdfs","length":0,"modificationTime":1540286695269,"owner":"hdfs","pathSuffix":"","permission":"555","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'') 2018-11-22 12:08:57,773 - HdfsResource['/hdp/apps/3.0.1.0-187/mapreduce/mapreduce.tar.gz'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'source': '/usr/hdp/3.0.1.0-187/hadoop/mapreduce.tar.gz', 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'replace_existing_files': False, 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hdfs', 'group': 'hadoop', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'file', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0444} 2018-11-22 12:08:57,774 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpsjXISL 2>/tmp/tmpnK0OSi''] {'quiet': False} 2018-11-22 12:08:57,811 - call returned (0, '') 2018-11-22 12:08:57,811 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "14 62 69 64 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1151,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350810,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367859123,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738279361,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:08:57,812 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmp1rYnIH 2>/tmp/tmpnHNNs7''] {'quiet': False} 2018-11-22 12:08:57,851 - call returned (0, '') 2018-11-22 12:08:57,851 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1150,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367859123,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738279361,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 111922,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:08:57,851 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:08:57,852 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/hdp/apps/3.0.1.0-187/mapreduce/mapreduce.tar.gz?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpNw2mTt 2>/tmp/tmp0IW0Gq''] {'logoutput': None, 'quiet': False} 2018-11-22 12:08:57,891 - call returned (0, '') 2018-11-22 12:08:57,891 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":1539600935121,"blockSize":134217728,"childrenNum":0,"fileId":17264,"group":"hadoop","length":307712858,"modificationTime":1539600961828,"owner":"hdfs","pathSuffix":"","permission":"444","replication":2,"storagePolicy":0,"type":"FILE"}}200', u'') 2018-11-22 12:08:57,891 - DFS file /hdp/apps/3.0.1.0-187/mapreduce/mapreduce.tar.gz is identical to /usr/hdp/3.0.1.0-187/hadoop/mapreduce.tar.gz, skipping the copying 2018-11-22 12:08:57,891 - Will attempt to copy mapreduce tarball from /usr/hdp/3.0.1.0-187/hadoop/mapreduce.tar.gz to DFS at /hdp/apps/3.0.1.0-187/mapreduce/mapreduce.tar.gz. 2018-11-22 12:08:57,892 - Called copy_to_hdfs tarball: tez 2018-11-22 12:08:57,892 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:08:57,892 - Tarball version was calcuated as 3.0.1.0-187. Use Command Version: True 2018-11-22 12:08:57,892 - Source file: /usr/hdp/3.0.1.0-187/tez/lib/tez.tar.gz , Dest file in HDFS: /hdp/apps/3.0.1.0-187/tez/tez.tar.gz 2018-11-22 12:08:57,892 - Preparing the Tez tarball... 2018-11-22 12:08:57,892 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:08:57,892 - Tarball version was calcuated as 3.0.1.0-187. Use Command Version: True 2018-11-22 12:08:57,892 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:08:57,892 - Tarball version was calcuated as 3.0.1.0-187. Use Command Version: True 2018-11-22 12:08:57,892 - Extracting /usr/hdp/3.0.1.0-187/hadoop/mapreduce.tar.gz to /var/lib/ambari-agent/tmp/mapreduce-tarball-8X2N_L 2018-11-22 12:08:57,892 - Execute[('tar', '-xf', u'/usr/hdp/3.0.1.0-187/hadoop/mapreduce.tar.gz', '-C', '/var/lib/ambari-agent/tmp/mapreduce-tarball-8X2N_L/')] {'tries': 3, 'sudo': True, 'try_sleep': 1} 2018-11-22 12:09:00,219 - Extracting /usr/hdp/3.0.1.0-187/tez/lib/tez.tar.gz to /var/lib/ambari-agent/tmp/tez-tarball-VdGLnc 2018-11-22 12:09:00,219 - Execute[('tar', '-xf', u'/usr/hdp/3.0.1.0-187/tez/lib/tez.tar.gz', '-C', '/var/lib/ambari-agent/tmp/tez-tarball-VdGLnc/')] {'tries': 3, 'sudo': True, 'try_sleep': 1} 2018-11-22 12:09:01,653 - Execute[('cp', '-a', '/var/lib/ambari-agent/tmp/mapreduce-tarball-8X2N_L/hadoop/lib/native', '/var/lib/ambari-agent/tmp/tez-tarball-VdGLnc/lib')] {'sudo': True} 2018-11-22 12:09:01,668 - Directory['/var/lib/ambari-agent/tmp/tez-tarball-VdGLnc/lib'] {'recursive_ownership': True, 'mode': 0755, 'cd_access': 'a'} 2018-11-22 12:09:01,669 - Creating a new Tez tarball at /var/lib/ambari-agent/tmp/tez-native-tarball-staging/tez-native.tar.gz 2018-11-22 12:09:01,669 - Execute[('tar', '-zchf', '/tmp/tmpU1dMGS', '-C', '/var/lib/ambari-agent/tmp/tez-tarball-VdGLnc', '.')] {'tries': 3, 'sudo': True, 'try_sleep': 1} 2018-11-22 12:09:10,852 - Execute[('mv', '/tmp/tmpU1dMGS', '/var/lib/ambari-agent/tmp/tez-native-tarball-staging/tez-native.tar.gz')] {} 2018-11-22 12:09:14,043 - HdfsResource['/hdp/apps/3.0.1.0-187/tez'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hdfs', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0555} 2018-11-22 12:09:14,044 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpEkq9ll 2>/tmp/tmpWuUzp9''] {'quiet': False} 2018-11-22 12:09:14,081 - call returned (0, '') 2018-11-22 12:09:14,081 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,091 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpSdsKXh 2>/tmp/tmprvcylD''] {'quiet': False} 2018-11-22 12:09:14,130 - call returned (0, '') 2018-11-22 12:09:14,130 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,131 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:14,131 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/hdp/apps/3.0.1.0-187/tez?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmp6zv7Vs 2>/tmp/tmp7qixOZ''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:14,170 - call returned (0, '') 2018-11-22 12:09:14,170 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":1,"fileId":18638,"group":"hdfs","length":0,"modificationTime":1540286397270,"owner":"hdfs","pathSuffix":"","permission":"555","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'') 2018-11-22 12:09:14,171 - HdfsResource['/hdp/apps/3.0.1.0-187/tez/tez.tar.gz'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'source': '/var/lib/ambari-agent/tmp/tez-native-tarball-staging/tez-native.tar.gz', 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'replace_existing_files': False, 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hdfs', 'group': 'hadoop', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'file', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0444} 2018-11-22 12:09:14,171 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpjg5uZt 2>/tmp/tmpeiVPLC''] {'quiet': False} 2018-11-22 12:09:14,208 - call returned (0, '') 2018-11-22 12:09:14,209 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,210 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpXTWDHb 2>/tmp/tmpSeaQpG''] {'quiet': False} 2018-11-22 12:09:14,248 - call returned (0, '') 2018-11-22 12:09:14,248 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,249 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:14,250 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/hdp/apps/3.0.1.0-187/tez/tez.tar.gz?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmp92dhYy 2>/tmp/tmpmVq4Sd''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:14,288 - call returned (0, '') 2018-11-22 12:09:14,288 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":1540286397270,"blockSize":134217728,"childrenNum":0,"fileId":18639,"group":"hadoop","length":254035812,"modificationTime":1540286419421,"owner":"hdfs","pathSuffix":"","permission":"444","replication":2,"storagePolicy":0,"type":"FILE"}}200', u'') 2018-11-22 12:09:14,289 - Not replacing existing DFS file /hdp/apps/3.0.1.0-187/tez/tez.tar.gz which is different from /var/lib/ambari-agent/tmp/tez-native-tarball-staging/tez-native.tar.gz, due to replace_existing_files=False 2018-11-22 12:09:14,289 - Will attempt to copy tez tarball from /var/lib/ambari-agent/tmp/tez-native-tarball-staging/tez-native.tar.gz to DFS at /hdp/apps/3.0.1.0-187/tez/tez.tar.gz. 2018-11-22 12:09:14,289 - Called copy_to_hdfs tarball: pig 2018-11-22 12:09:14,289 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:09:14,289 - Tarball version was calcuated as 3.0.1.0-187. Use Command Version: True 2018-11-22 12:09:14,289 - pig-env is not present on the cluster. Skip copying /usr/hdp/3.0.1.0-187/pig/pig.tar.gz 2018-11-22 12:09:14,289 - Called copy_to_hdfs tarball: hive 2018-11-22 12:09:14,289 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:09:14,289 - Tarball version was calcuated as 3.0.1.0-187. Use Command Version: True 2018-11-22 12:09:14,289 - Source file: /usr/hdp/3.0.1.0-187/hive/hive.tar.gz , Dest file in HDFS: /hdp/apps/3.0.1.0-187/hive/hive.tar.gz 2018-11-22 12:09:14,290 - HdfsResource['/hdp/apps/3.0.1.0-187/hive'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hdfs', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0555} 2018-11-22 12:09:14,290 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpTObKOU 2>/tmp/tmp8JZFrt''] {'quiet': False} 2018-11-22 12:09:14,328 - call returned (0, '') 2018-11-22 12:09:14,328 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,329 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpqKPKTL 2>/tmp/tmpHUv8Nk''] {'quiet': False} 2018-11-22 12:09:14,367 - call returned (0, '') 2018-11-22 12:09:14,367 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,368 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:14,368 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/hdp/apps/3.0.1.0-187/hive?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmp6ruaw_ 2>/tmp/tmpzLRU9g''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:14,407 - call returned (0, '') 2018-11-22 12:09:14,407 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":1,"fileId":18747,"group":"hdfs","length":0,"modificationTime":1540286652134,"owner":"hdfs","pathSuffix":"","permission":"555","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'') 2018-11-22 12:09:14,408 - HdfsResource['/hdp/apps/3.0.1.0-187/hive/hive.tar.gz'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'source': '/usr/hdp/3.0.1.0-187/hive/hive.tar.gz', 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'replace_existing_files': False, 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hdfs', 'group': 'hadoop', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'file', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0444} 2018-11-22 12:09:14,408 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpF1HFqY 2>/tmp/tmpeZHLul''] {'quiet': False} 2018-11-22 12:09:14,446 - call returned (0, '') 2018-11-22 12:09:14,446 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,447 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpMkrKEf 2>/tmp/tmpsoteAQ''] {'quiet': False} 2018-11-22 12:09:14,486 - call returned (0, '') 2018-11-22 12:09:14,486 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,486 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:14,487 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/hdp/apps/3.0.1.0-187/hive/hive.tar.gz?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpnhuOqK 2>/tmp/tmpPrI6NT''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:14,526 - call returned (0, '') 2018-11-22 12:09:14,526 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":1540286652134,"blockSize":134217728,"childrenNum":0,"fileId":18748,"group":"hadoop","length":381339333,"modificationTime":1540286685214,"owner":"hdfs","pathSuffix":"","permission":"444","replication":2,"storagePolicy":0,"type":"FILE"}}200', u'') 2018-11-22 12:09:14,527 - DFS file /hdp/apps/3.0.1.0-187/hive/hive.tar.gz is identical to /usr/hdp/3.0.1.0-187/hive/hive.tar.gz, skipping the copying 2018-11-22 12:09:14,527 - Will attempt to copy hive tarball from /usr/hdp/3.0.1.0-187/hive/hive.tar.gz to DFS at /hdp/apps/3.0.1.0-187/hive/hive.tar.gz. 2018-11-22 12:09:14,527 - Called copy_to_hdfs tarball: sqoop 2018-11-22 12:09:14,527 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:09:14,527 - Tarball version was calcuated as 3.0.1.0-187. Use Command Version: True 2018-11-22 12:09:14,527 - Source file: /usr/hdp/3.0.1.0-187/sqoop/sqoop.tar.gz , Dest file in HDFS: /hdp/apps/3.0.1.0-187/sqoop/sqoop.tar.gz 2018-11-22 12:09:14,527 - HdfsResource['/hdp/apps/3.0.1.0-187/sqoop'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hdfs', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0555} 2018-11-22 12:09:14,528 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmp_yqneF 2>/tmp/tmpdISFKa''] {'quiet': False} 2018-11-22 12:09:14,565 - call returned (0, '') 2018-11-22 12:09:14,565 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,573 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpR0aTKx 2>/tmp/tmpIwOGyA''] {'quiet': False} 2018-11-22 12:09:14,611 - call returned (0, '') 2018-11-22 12:09:14,611 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,612 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:14,613 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/hdp/apps/3.0.1.0-187/sqoop?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpYncu_w 2>/tmp/tmpDTJYxq''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:14,652 - call returned (0, '') 2018-11-22 12:09:14,652 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":1,"fileId":18749,"group":"hdfs","length":0,"modificationTime":1540286686982,"owner":"hdfs","pathSuffix":"","permission":"555","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'') 2018-11-22 12:09:14,653 - HdfsResource['/hdp/apps/3.0.1.0-187/sqoop/sqoop.tar.gz'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'source': '/usr/hdp/3.0.1.0-187/sqoop/sqoop.tar.gz', 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'replace_existing_files': False, 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hdfs', 'group': 'hadoop', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'file', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0444} 2018-11-22 12:09:14,653 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpURZvXF 2>/tmp/tmpJmu5hL''] {'quiet': False} 2018-11-22 12:09:14,690 - call returned (0, '') 2018-11-22 12:09:14,691 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,691 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpfovIzy 2>/tmp/tmpE4epyt''] {'quiet': False} 2018-11-22 12:09:14,730 - call returned (0, '') 2018-11-22 12:09:14,730 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,731 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:14,731 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/hdp/apps/3.0.1.0-187/sqoop/sqoop.tar.gz?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpCYRodX 2>/tmp/tmpvtKbyr''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:14,770 - call returned (0, '') 2018-11-22 12:09:14,770 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":1540286686982,"blockSize":134217728,"childrenNum":0,"fileId":18750,"group":"hadoop","length":83672044,"modificationTime":1540286694723,"owner":"hdfs","pathSuffix":"","permission":"444","replication":2,"storagePolicy":0,"type":"FILE"}}200', u'') 2018-11-22 12:09:14,771 - DFS file /hdp/apps/3.0.1.0-187/sqoop/sqoop.tar.gz is identical to /usr/hdp/3.0.1.0-187/sqoop/sqoop.tar.gz, skipping the copying 2018-11-22 12:09:14,771 - Will attempt to copy sqoop tarball from /usr/hdp/3.0.1.0-187/sqoop/sqoop.tar.gz to DFS at /hdp/apps/3.0.1.0-187/sqoop/sqoop.tar.gz. 2018-11-22 12:09:14,771 - Called copy_to_hdfs tarball: hadoop_streaming 2018-11-22 12:09:14,771 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=3.0.1.0-187 -> 3.0.1.0-187 2018-11-22 12:09:14,771 - Tarball version was calcuated as 3.0.1.0-187. Use Command Version: True 2018-11-22 12:09:14,771 - Source file: /usr/hdp/3.0.1.0-187/hadoop-mapreduce/hadoop-streaming.jar , Dest file in HDFS: /hdp/apps/3.0.1.0-187/mapreduce/hadoop-streaming.jar 2018-11-22 12:09:14,771 - HdfsResource['/hdp/apps/3.0.1.0-187/mapreduce'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hdfs', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0555} 2018-11-22 12:09:14,772 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpeXg7DF 2>/tmp/tmpvQlv28''] {'quiet': False} 2018-11-22 12:09:14,810 - call returned (0, '') 2018-11-22 12:09:14,811 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,812 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpo4IXMS 2>/tmp/tmp2LDOby''] {'quiet': False} 2018-11-22 12:09:14,850 - call returned (0, '') 2018-11-22 12:09:14,850 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,850 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:14,851 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/hdp/apps/3.0.1.0-187/mapreduce?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpEwpGnm 2>/tmp/tmpoBFF3y''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:14,889 - call returned (0, '') 2018-11-22 12:09:14,890 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"blockSize":0,"childrenNum":2,"fileId":16399,"group":"hdfs","length":0,"modificationTime":1540286695269,"owner":"hdfs","pathSuffix":"","permission":"555","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'') 2018-11-22 12:09:14,891 - HdfsResource['/hdp/apps/3.0.1.0-187/mapreduce/hadoop-streaming.jar'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'source': '/usr/hdp/3.0.1.0-187/hadoop-mapreduce/hadoop-streaming.jar', 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'replace_existing_files': False, 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hdfs', 'group': 'hadoop', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'file', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 0444} 2018-11-22 12:09:14,892 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpGnuEsx 2>/tmp/tmpF81cNa''] {'quiet': False} 2018-11-22 12:09:14,929 - call returned (0, '') 2018-11-22 12:09:14,929 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,930 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpH4Ph6w 2>/tmp/tmpE9HKMH''] {'quiet': False} 2018-11-22 12:09:14,969 - call returned (0, '') 2018-11-22 12:09:14,969 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:14,970 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:14,970 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/hdp/apps/3.0.1.0-187/mapreduce/hadoop-streaming.jar?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpMtPYNP 2>/tmp/tmpF3plsI''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:15,009 - call returned (0, '') 2018-11-22 12:09:15,009 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":1540286695269,"blockSize":134217728,"childrenNum":0,"fileId":18751,"group":"hadoop","length":176345,"modificationTime":1540286695427,"owner":"hdfs","pathSuffix":"","permission":"444","replication":2,"storagePolicy":0,"type":"FILE"}}200', u'') 2018-11-22 12:09:15,010 - DFS file /hdp/apps/3.0.1.0-187/mapreduce/hadoop-streaming.jar is identical to /usr/hdp/3.0.1.0-187/hadoop-mapreduce/hadoop-streaming.jar, skipping the copying 2018-11-22 12:09:15,010 - Will attempt to copy hadoop_streaming tarball from /usr/hdp/3.0.1.0-187/hadoop-mapreduce/hadoop-streaming.jar to DFS at /hdp/apps/3.0.1.0-187/mapreduce/hadoop-streaming.jar. 2018-11-22 12:09:15,010 - HdfsResource['/warehouse/tablespace/external/hive/sys.db/'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01755} 2018-11-22 12:09:15,010 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpdHd0iF 2>/tmp/tmpR1r9Xf''] {'quiet': False} 2018-11-22 12:09:15,048 - call returned (0, '') 2018-11-22 12:09:15,048 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:15,049 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpUBqOLf 2>/tmp/tmpW5AWr5''] {'quiet': False} 2018-11-22 12:09:15,087 - call returned (0, '') 2018-11-22 12:09:15,088 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:15,088 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:15,089 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/warehouse/tablespace/external/hive/sys.db/?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpcOxPnc 2>/tmp/tmpsSfnP3''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:15,128 - call returned (0, '') 2018-11-22 12:09:15,128 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"aclBit":true,"blockSize":0,"childrenNum":46,"fileId":18654,"group":"hadoop","length":0,"modificationTime":1540286696870,"owner":"hive","pathSuffix":"","permission":"1755","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'') 2018-11-22 12:09:15,129 - HdfsResource['/warehouse/tablespace/external/hive/sys.db/query_data/'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01777} 2018-11-22 12:09:15,129 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmp1JXpED 2>/tmp/tmpq8fuQM''] {'quiet': False} 2018-11-22 12:09:15,166 - call returned (0, '') 2018-11-22 12:09:15,166 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:15,167 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpLPH7Wr 2>/tmp/tmpkbrpLc''] {'quiet': False} 2018-11-22 12:09:15,205 - call returned (0, '') 2018-11-22 12:09:15,206 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:15,213 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:15,214 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/warehouse/tablespace/external/hive/sys.db/query_data/?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpmSD6LI 2>/tmp/tmp7YleAp''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:15,252 - call returned (0, '') 2018-11-22 12:09:15,252 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"aclBit":true,"blockSize":0,"childrenNum":4,"fileId":18655,"group":"hadoop","length":0,"modificationTime":1542800779361,"owner":"hive","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'') 2018-11-22 12:09:15,260 - HdfsResource['/warehouse/tablespace/external/hive/sys.db/dag_meta'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01777} 2018-11-22 12:09:15,260 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpylTWaI 2>/tmp/tmp1t31op''] {'quiet': False} 2018-11-22 12:09:15,297 - call returned (0, '') 2018-11-22 12:09:15,298 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:15,298 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpW_XfDq 2>/tmp/tmpb_UPmb''] {'quiet': False} 2018-11-22 12:09:15,337 - call returned (0, '') 2018-11-22 12:09:15,337 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:15,338 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:15,338 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/warehouse/tablespace/external/hive/sys.db/dag_meta?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpfXTcwK 2>/tmp/tmplQ7oL_''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:15,377 - call returned (0, '') 2018-11-22 12:09:15,377 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"aclBit":true,"blockSize":0,"childrenNum":0,"fileId":18752,"group":"hadoop","length":0,"modificationTime":1540286696133,"owner":"hive","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'') 2018-11-22 12:09:15,378 - HdfsResource['/warehouse/tablespace/external/hive/sys.db/dag_data'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01777} 2018-11-22 12:09:15,378 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmpyZD0RX 2>/tmp/tmpbqqjsG''] {'quiet': False} 2018-11-22 12:09:15,416 - call returned (0, '') 2018-11-22 12:09:15,417 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:15,418 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmp1kHepl 2>/tmp/tmpCZr_Qi''] {'quiet': False} 2018-11-22 12:09:15,456 - call returned (0, '') 2018-11-22 12:09:15,456 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:15,457 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:15,457 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/warehouse/tablespace/external/hive/sys.db/dag_data?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpiiLmAa 2>/tmp/tmp0BGl_Q''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:15,496 - call returned (0, '') 2018-11-22 12:09:15,496 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"aclBit":true,"blockSize":0,"childrenNum":0,"fileId":18753,"group":"hadoop","length":0,"modificationTime":1540286696503,"owner":"hive","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'') 2018-11-22 12:09:15,497 - HdfsResource['/warehouse/tablespace/external/hive/sys.db/app_data'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'owner': 'hive', 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'type': 'directory', 'action': ['create_on_execute'], 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp'], 'mode': 01777} 2018-11-22 12:09:15,497 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hmaster.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmp5n81Eo 2>/tmp/tmpeJEIcX''] {'quiet': False} 2018-11-22 12:09:15,534 - call returned (0, '') 2018-11-22 12:09:15,535 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "active",\n "tag.TotalSyncTimes" : "17 359 323 1015 ",\n "tag.Hostname" : "hmaster.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1153,\n "TransactionsSinceLastLogRoll" : 1,\n "LastWrittenTransactionId" : 350812,\n "LastCheckpointTime" : 1542865361000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 386,\n "LowRedundancyBlocks" : 386,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 8,\n "LowRedundancyReplicatedBlocks" : 386,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 8,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 54,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 0,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 3,\n "TotalSyncCount" : 1,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:15,536 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -s '"'"'http://hdata2.nic.in:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem'"'"' 1>/tmp/tmp2MPcaM 2>/tmp/tmpiP_nl1''] {'quiet': False} 2018-11-22 12:09:15,573 - call returned (0, '') 2018-11-22 12:09:15,573 - get_user_call_output returned (0, u'{\n "beans" : [ {\n "name" : "Hadoop:service=NameNode,name=FSNamesystem",\n "modelerType" : "FSNamesystem",\n "tag.Context" : "dfs",\n "tag.HAState" : "standby",\n "tag.TotalSyncTimes" : "",\n "tag.Hostname" : "hdata2.nic.in",\n "MissingBlocks" : 0,\n "MissingReplOneBlocks" : 0,\n "ExpiredHeartbeats" : 0,\n "TransactionsSinceLastCheckpoint" : 1152,\n "TransactionsSinceLastLogRoll" : 0,\n "LastWrittenTransactionId" : 350069,\n "LastCheckpointTime" : 1542865362000,\n "CapacityTotal" : 1449633118208,\n "CapacityTotalGB" : 1350.0,\n "CapacityUsed" : 125367869440,\n "CapacityUsedGB" : 117.0,\n "CapacityRemaining" : 1281738269044,\n "ProvidedCapacityTotal" : 0,\n "CapacityRemainingGB" : 1194.0,\n "CapacityUsedNonDFS" : 0,\n "TotalLoad" : 16,\n "SnapshottableDirectories" : 0,\n "Snapshots" : 0,\n "NumEncryptionZones" : 0,\n "LockQueueLength" : 0,\n "BlocksTotal" : 3521,\n "NumFilesUnderConstruction" : 3,\n "NumActiveClients" : 2,\n "FilesTotal" : 4681,\n "PendingReplicationBlocks" : 0,\n "PendingReconstructionBlocks" : 0,\n "UnderReplicatedBlocks" : 0,\n "LowRedundancyBlocks" : 0,\n "CorruptBlocks" : 0,\n "ScheduledReplicationBlocks" : 0,\n "PendingDeletionBlocks" : 0,\n "LowRedundancyReplicatedBlocks" : 0,\n "CorruptReplicatedBlocks" : 0,\n "MissingReplicatedBlocks" : 0,\n "MissingReplicationOneBlocks" : 0,\n "HighestPriorityLowRedundancyReplicatedBlocks" : 0,\n "HighestPriorityLowRedundancyECBlocks" : 0,\n "BytesInFutureReplicatedBlocks" : 0,\n "PendingDeletionReplicatedBlocks" : 0,\n "TotalReplicatedBlocks" : 3521,\n "LowRedundancyECBlockGroups" : 0,\n "CorruptECBlockGroups" : 0,\n "MissingECBlockGroups" : 0,\n "BytesInFutureECBlockGroups" : 0,\n "PendingDeletionECBlocks" : 0,\n "TotalECBlockGroups" : 0,\n "ExcessBlocks" : 0,\n "NumTimedOutPendingReconstructions" : 0,\n "PostponedMisreplicatedBlocks" : 0,\n "PendingDataNodeMessageCount" : 0,\n "MillisSinceLastLoadedEdits" : 4463,\n "BlockCapacity" : 2097152,\n "NumLiveDataNodes" : 2,\n "NumDeadDataNodes" : 0,\n "NumDecomLiveDataNodes" : 0,\n "NumDecomDeadDataNodes" : 0,\n "VolumeFailuresTotal" : 0,\n "EstimatedCapacityLostTotal" : 0,\n "NumDecommissioningDataNodes" : 0,\n "StaleDataNodes" : 0,\n "NumStaleStorages" : 0,\n "TotalSyncCount" : 0,\n "NumInMaintenanceLiveDataNodes" : 0,\n "NumInMaintenanceDeadDataNodes" : 0,\n "NumEnteringMaintenanceDataNodes" : 0\n } ]\n}', u'') 2018-11-22 12:09:15,577 - NameNode HA states: active_namenodes = [(u'nn1', 'hmaster.nic.in:50070')], standby_namenodes = [(u'nn2', 'hdata2.nic.in:50070')], unknown_namenodes = [] 2018-11-22 12:09:15,577 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://hmaster.nic.in:50070/webhdfs/v1/warehouse/tablespace/external/hive/sys.db/app_data?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpWuZlXJ 2>/tmp/tmp4SwCWM''] {'logoutput': None, 'quiet': False} 2018-11-22 12:09:15,616 - call returned (0, '') 2018-11-22 12:09:15,616 - get_user_call_output returned (0, u'{"FileStatus":{"accessTime":0,"aclBit":true,"blockSize":0,"childrenNum":1,"fileId":18754,"group":"hadoop","length":0,"modificationTime":1542281178123,"owner":"hive","pathSuffix":"","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}}200', u'') 2018-11-22 12:09:15,617 - HdfsResource[None] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/3.0.1.0-187/hadoop/bin', 'keytab': [EMPTY], 'dfs_type': 'HDFS', 'default_fs': 'hdfs://icjs', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': 'missing_principal', 'user': 'hdfs', 'action': ['execute'], 'hadoop_conf_dir': '/usr/hdp/3.0.1.0-187/hadoop/conf', 'immutable_paths': [u'/mr-history/done', u'/warehouse/tablespace/managed/hive', u'/warehouse/tablespace/external/hive', u'/app-logs', u'/tmp']} 2018-11-22 12:09:15,619 - Directory['/usr/lib/ambari-logsearch-logfeeder/conf'] {'create_parents': True, 'mode': 0755, 'cd_access': 'a'} 2018-11-22 12:09:15,619 - Generate Log Feeder config file: /usr/lib/ambari-logsearch-logfeeder/conf/input.config-hive.json 2018-11-22 12:09:15,620 - File['/usr/lib/ambari-logsearch-logfeeder/conf/input.config-hive.json'] {'content': Template('input.config-hive.json.j2'), 'mode': 0644} 2018-11-22 12:09:15,620 - Ranger Hive plugin is not enabled 2018-11-22 12:09:15,620 - call['ambari-sudo.sh su hive -l -s /bin/bash -c 'cat /var/run/hive/hive-server.pid 1>/tmp/tmpEco35Y 2>/tmp/tmpK07NJf''] {'quiet': False} 2018-11-22 12:09:15,651 - call returned (0, '') 2018-11-22 12:09:15,651 - get_user_call_output returned (0, u'31314', u'') 2018-11-22 12:09:15,651 - call['ambari-sudo.sh su hive -l -s /bin/bash -c 'hive --config /usr/hdp/current/hive-server2/conf/ --service metatool -listFSRoot' 2>/dev/null | grep hdfs:// | cut -f1,2,3 -d '/' | grep -v 'hdfs://icjs' | head -1'] {} 2018-11-22 12:09:21,145 - call returned (0, '') 2018-11-22 12:09:21,145 - Execute['/var/lib/ambari-agent/tmp/start_hiveserver2_script /var/log/hive/hive-server2.out /var/log/hive/hive-server2.err /var/run/hive/hive-server.pid /usr/hdp/current/hive-server2/conf/ /etc/tez/conf'] {'environment': {'HIVE_BIN': 'hive', 'JAVA_HOME': u'/home/java/jdk1.8.0_181', 'HADOOP_HOME': u'/usr/hdp/current/hadoop-client'}, 'not_if': 'ls /var/run/hive/hive-server.pid >/dev/null 2>&1 && ps -p 31314 >/dev/null 2>&1', 'user': 'hive', 'path': [u'/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/sbin:/sbin:/usr/lib/ambari-server/*:/home/java/jdk1.8.0_181/bin:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin:/var/lib/ambari-agent:/var/lib/ambari-agent:/usr/hdp/current/hive-server2/bin:/usr/hdp/3.0.1.0-187/hadoop/bin']} 2018-11-22 12:09:21,190 - Execute['/home/java/jdk1.8.0_181/bin/java -cp /usr/lib/ambari-agent/DBConnectionVerification.jar:/usr/hdp/current/hive-server2/lib/postgresql-42.2.5.jar org.apache.ambari.server.DBConnectionVerification 'jdbc:postgresql://hmaster.nic.in:5432/hive' hive [PROTECTED] org.postgresql.Driver'] {'path': ['/usr/sbin:/sbin:/usr/local/bin:/bin:/usr/bin'], 'tries': 5, 'try_sleep': 10} 2018-11-22 12:09:21,330 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:09:21,888 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:09:21,889 - Will retry 29 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:09:31,897 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:09:32,431 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:09:32,432 - Will retry 28 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:09:42,437 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:09:42,939 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:09:42,939 - Will retry 27 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:09:52,946 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:09:53,499 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:09:53,499 - Will retry 26 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:10:03,509 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:10:04,021 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:10:04,021 - Will retry 25 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:10:14,031 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:10:14,541 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:10:14,541 - Will retry 24 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:10:24,552 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:10:25,063 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:10:25,064 - Will retry 23 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:10:35,074 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:10:35,604 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:10:35,604 - Will retry 22 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:10:45,610 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:10:46,121 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:10:46,121 - Will retry 21 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:10:56,127 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:10:56,637 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:10:56,638 - Will retry 20 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:11:06,648 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:11:07,155 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:11:07,155 - Will retry 19 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:11:17,164 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:11:17,669 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:11:17,670 - Will retry 18 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:11:27,677 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:11:28,179 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:11:28,180 - Will retry 17 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:11:38,188 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:11:38,703 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:11:38,704 - Will retry 16 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:11:48,714 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:11:49,223 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:11:49,223 - Will retry 15 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:11:59,233 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:11:59,743 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:11:59,744 - Will retry 14 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:12:09,752 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:12:10,257 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:12:10,257 - Will retry 13 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:12:20,259 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:12:20,767 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:12:20,767 - Will retry 12 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:12:30,773 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:12:31,283 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:12:31,284 - Will retry 11 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:12:41,294 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:12:41,815 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:12:41,816 - Will retry 10 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:12:51,826 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:12:52,342 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:12:52,342 - Will retry 9 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:13:02,352 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:13:02,865 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:13:02,866 - Will retry 8 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:13:12,881 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:13:13,433 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:13:13,434 - Will retry 7 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:13:23,443 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server hmaster.nic.in:2181,hdata1.nic.in:2181,hdata2.nic.in:2181 ls /hiveserver2 | grep 'serverUri=''] {} 2018-11-22 12:13:23,956 - call returned (1, 'Node does not exist: /hiveserver2') 2018-11-22 12:13:23,956 - Will retry 6 time(s), caught exception: ZooKeeper node /hiveserver2 is not ready yet. Sleeping for 10 sec(s) 2018-11-22 12:13:33,957 - Process with pid 18443 is not running. Stale pid file at /var/run/hive/hive-server.pid Command failed after 1 tries