2017-12-07 16:43:15,579 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6 2017-12-07 16:43:15,585 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2017-12-07 16:43:15,586 - Group['livy'] {} 2017-12-07 16:43:15,587 - Group['spark'] {} 2017-12-07 16:43:15,587 - Group['hdfs'] {} 2017-12-07 16:43:15,587 - Group['zeppelin'] {} 2017-12-07 16:43:15,588 - Group['hadoop'] {} 2017-12-07 16:43:15,588 - Group['nifi'] {} 2017-12-07 16:43:15,588 - Group['users'] {} 2017-12-07 16:43:15,589 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,590 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,590 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,591 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2017-12-07 16:43:15,592 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,593 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2017-12-07 16:43:15,594 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'zeppelin', u'hadoop'], 'uid': None} 2017-12-07 16:43:15,595 - User['nifi'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,596 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,596 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,597 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2017-12-07 16:43:15,598 - User['flume'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,599 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,600 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs'], 'uid': None} 2017-12-07 16:43:15,601 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,602 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,602 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,603 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,604 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-07 16:43:15,605 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2017-12-07 16:43:15,606 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2017-12-07 16:43:15,610 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if 2017-12-07 16:43:15,610 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'} 2017-12-07 16:43:15,611 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2017-12-07 16:43:15,613 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2017-12-07 16:43:15,613 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {} 2017-12-07 16:43:15,619 - call returned (0, '1027') 2017-12-07 16:43:15,619 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1027'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'} 2017-12-07 16:43:15,622 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1027'] due to not_if 2017-12-07 16:43:15,623 - Group['hdfs'] {} 2017-12-07 16:43:15,623 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', u'hdfs']} 2017-12-07 16:43:15,623 - FS Type: 2017-12-07 16:43:15,624 - Directory['/etc/hadoop'] {'mode': 0755} 2017-12-07 16:43:15,640 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} 2017-12-07 16:43:15,640 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777} 2017-12-07 16:43:15,654 - Repository['HDF-3.0-repo-1'] {'append_to_file': False, 'base_url': 'http://192.168.1.10/hdf/HDF/centos7/3.0.2.0-76/', 'action': ['create'], 'components': [u'HDF', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''} 2017-12-07 16:43:15,661 - File['/etc/yum.repos.d/ambari-hdp-1.repo'] {'content': '[HDF-3.0-repo-1]\nname=HDF-3.0-repo-1\nbaseurl=http://192.168.1.10/hdf/HDF/centos7/3.0.2.0-76/\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-12-07 16:43:15,662 - Writing File['/etc/yum.repos.d/ambari-hdp-1.repo'] because contents don't match 2017-12-07 16:43:15,676 - Repository['HDP-2.6-repo-1'] {'append_to_file': True, 'base_url': 'http://192.168.1.10/hdp/HDP/centos7/2.6.3.0-235/', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''} 2017-12-07 16:43:15,679 - File['/etc/yum.repos.d/ambari-hdp-1.repo'] {'content': '[HDF-3.0-repo-1]\nname=HDF-3.0-repo-1\nbaseurl=http://192.168.1.10/hdf/HDF/centos7/3.0.2.0-76/\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-2.6-repo-1]\nname=HDP-2.6-repo-1\nbaseurl=http://192.168.1.10/hdp/HDP/centos7/2.6.3.0-235/\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-12-07 16:43:15,680 - Writing File['/etc/yum.repos.d/ambari-hdp-1.repo'] because contents don't match 2017-12-07 16:43:15,680 - Repository['HDP-UTILS-1.1.0.21-repo-1'] {'append_to_file': True, 'base_url': 'http://192.168.1.10/hdp/HDP-UTILS-1.1.0.21/', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': ''} 2017-12-07 16:43:15,683 - File['/etc/yum.repos.d/ambari-hdp-1.repo'] {'content': '[HDF-3.0-repo-1]\nname=HDF-3.0-repo-1\nbaseurl=http://192.168.1.10/hdf/HDF/centos7/3.0.2.0-76/\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-2.6-repo-1]\nname=HDP-2.6-repo-1\nbaseurl=http://192.168.1.10/hdp/HDP/centos7/2.6.3.0-235/\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.21-repo-1]\nname=HDP-UTILS-1.1.0.21-repo-1\nbaseurl=http://192.168.1.10/hdp/HDP-UTILS-1.1.0.21/\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-12-07 16:43:15,683 - Writing File['/etc/yum.repos.d/ambari-hdp-1.repo'] because contents don't match 2017-12-07 16:43:15,723 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-12-07 16:43:15,781 - Skipping installation of existing package unzip 2017-12-07 16:43:15,781 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-12-07 16:43:15,790 - Skipping installation of existing package curl 2017-12-07 16:43:15,790 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-12-07 16:43:15,798 - Skipping installation of existing package hdp-select 2017-12-07 16:43:15,803 - The repository with version 2.6.3.0-235 for this command has been marked as resolved. It will be used to report the version of the component which was installed 2017-12-07 16:43:15,809 - Skipping stack-select on NIFI because it does not exist in the stack-select package structure. 2017-12-07 16:43:16,018 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6 2017-12-07 16:43:16,093 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2017-12-07 16:43:16,094 - Package['nifi_3_0_*'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-12-07 16:43:16,148 - Installing package nifi_3_0_* ('/usr/bin/yum -d 0 -e 0 -y install 'nifi_3_0_*'') 2017-12-07 16:44:58,917 - Directory['/usr/hdf/current/nifi'] {'owner': 'nifi', 'group': 'nifi', 'create_parents': True, 'recursive_ownership': True} 2017-12-07 16:44:58,918 - Creating directory Directory['/usr/hdf/current/nifi'] since it doesn't exist. 2017-12-07 16:44:58,918 - Following the link /usr/hdf/current/nifi to /usr/hdf/3.0.0.0-453/nifi to create the directory 2017-12-07 16:44:58,919 - Changing owner for /usr/hdf/3.0.0.0-453/nifi from 0 to nifi 2017-12-07 16:44:58,919 - Changing group for /usr/hdf/3.0.0.0-453/nifi from 0 to nifi 2017-12-07 16:44:58,921 - Directory['/var/run/nifi'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,921 - Directory['/var/log/nifi'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,922 - Directory['/var/lib/nifi'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,922 - Directory['/var/lib/nifi/database_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,923 - Directory['/var/lib/nifi/flowfile_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,923 - Directory['/var/lib/nifi/provenance_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,924 - Directory['/usr/hdf/current/nifi/conf'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,924 - Creating directory Directory['/usr/hdf/current/nifi/conf'] since it doesn't exist. 2017-12-07 16:44:58,924 - Changing owner for /usr/hdf/current/nifi/conf from 0 to nifi 2017-12-07 16:44:58,924 - Changing group for /usr/hdf/current/nifi/conf from 0 to nifi 2017-12-07 16:44:58,925 - Directory['/var/lib/nifi/conf'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,925 - Directory['/var/lib/nifi/state/local'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,925 - Directory['/usr/hdf/current/nifi/lib'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,925 - Creating directory Directory['/usr/hdf/current/nifi/lib'] since it doesn't exist. 2017-12-07 16:44:58,926 - Changing owner for /usr/hdf/current/nifi/lib from 0 to nifi 2017-12-07 16:44:58,926 - Changing group for /usr/hdf/current/nifi/lib from 0 to nifi 2017-12-07 16:44:58,926 - Directory['{{nifi_content_repo_dir_default}}'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True} 2017-12-07 16:44:58,926 - Directory['/var/lib/nifi/content_repository'] {'owner': 'nifi', 'group': 'nifi', 'create_parents': True, 'recursive_ownership': True} 2017-12-07 16:44:58,927 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'} 2017-12-07 16:44:58,931 - File['/etc/security/limits.d/nifi.conf'] {'content': Template('nifi.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644} 2017-12-07 16:44:58,932 - PropertiesFile['/usr/hdf/current/nifi/conf/nifi.properties'] {'owner': 'nifi', 'group': 'nifi', 'mode': 0600, 'properties': ...} 2017-12-07 16:44:58,937 - Generating properties file: /usr/hdf/current/nifi/conf/nifi.properties 2017-12-07 16:44:58,937 - File['/usr/hdf/current/nifi/conf/nifi.properties'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0600} 2017-12-07 16:44:59,020 - The repository with version 2.6.3.0-235 for this command has been marked as resolved. It will be used to report the version of the component which was installed 2017-12-07 16:44:59,037 - Skipping stack-select on NIFI because it does not exist in the stack-select package structure.