error.txt

2019-07-30 09:25:14,292 - Stack selector path does not exist
2019-07-30 09:25:14,321 - Could not determine stack version for component zookeeper-client by calling '/usr/bin/hdp-select status zookeeper-client > /tmp/tmpt21r4e'. Return Code: 1, Output: .
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 304, in <module>
    Master().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 143, in start
    self.configure(env, is_starting = True)
  File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 111, in configure
    self.write_configurations(params, is_starting)
  File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 247, in write_configurations
    support_encrypt_authorizers=params.stack_support_encrypt_authorizers
  File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi_toolkit_util_common.py", line 548, in encrypt_sensitive_properties
    encrypt_config_script = get_toolkit_script('encrypt-config.sh', toolkit_tmp_dir, stack_version_buildnum)
  File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi_toolkit_util_common.py", line 165, in get_toolkit_script
    Logger.info("Trying to find toolkit script dir with prefix: " + toolkitDirPrefix)
TypeError: cannot concatenate 'str' and 'NoneType' objects










output.txt

2019-07-30 09:25:13,857 - Stack Feature Version Info: Cluster Stack=3.1, Command Stack=None, Command Version=3.1.0.0-78 -> 3.1.0.0-78
2019-07-30 09:25:13,877 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-07-30 09:25:14,009 - Stack Feature Version Info: Cluster Stack=3.1, Command Stack=None, Command Version=3.1.0.0-78 -> 3.1.0.0-78
2019-07-30 09:25:14,015 - Using hadoop conf dir: /usr/hdp/3.1.0.0-78/hadoop/conf
2019-07-30 09:25:14,016 - Group['hdfs'] {}
2019-07-30 09:25:14,017 - Group['hadoop'] {}
2019-07-30 09:25:14,017 - Group['nifi'] {}
2019-07-30 09:25:14,018 - Group['users'] {}
2019-07-30 09:25:14,018 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-07-30 09:25:14,019 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None}
2019-07-30 09:25:14,020 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None}
2019-07-30 09:25:14,021 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop'], 'uid': None}
2019-07-30 09:25:14,022 - User['nifi'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['nifi'], 'uid': None}
2019-07-30 09:25:14,023 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2019-07-30 09:25:14,024 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2019-07-30 09:25:14,029 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if
2019-07-30 09:25:14,030 - Group['hdfs'] {}
2019-07-30 09:25:14,030 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hadoop', u'hdfs']}
2019-07-30 09:25:14,031 - FS Type: HDFS
2019-07-30 09:25:14,031 - Directory['/etc/hadoop'] {'mode': 0755}
2019-07-30 09:25:14,047 - File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2019-07-30 09:25:14,048 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2019-07-30 09:25:14,063 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2019-07-30 09:25:14,072 - Skipping Execute[('setenforce', '0')] due to only_if
2019-07-30 09:25:14,072 - Directory['/dtf/components/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2019-07-30 09:25:14,074 - Directory['/dtf/components/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2019-07-30 09:25:14,075 - Directory['/dtf/components/run/hadoop/hdfs'] {'owner': 'hdfs', 'cd_access': 'a'}
2019-07-30 09:25:14,076 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
2019-07-30 09:25:14,079 - File['/usr/hdp/3.1.0.0-78/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2019-07-30 09:25:14,081 - File['/usr/hdp/3.1.0.0-78/hadoop/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2019-07-30 09:25:14,086 - File['/usr/hdp/3.1.0.0-78/hadoop/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2019-07-30 09:25:14,096 - File['/usr/hdp/3.1.0.0-78/hadoop/conf/hadoop-metrics2.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2019-07-30 09:25:14,097 - File['/usr/hdp/3.1.0.0-78/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2019-07-30 09:25:14,101 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644}
2019-07-30 09:25:14,105 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2019-07-30 09:25:14,108 - Skipping unlimited key JCE policy check and setup since the Java VM is not managed by Ambari
2019-07-30 09:25:14,116 - Skipping stack-select on NIFI because it does not exist in the stack-select package structure.
2019-07-30 09:25:14,292 - Stack selector path does not exist
2019-07-30 09:25:14,321 - Could not determine stack version for component zookeeper-client by calling '/usr/bin/hdp-select status zookeeper-client > /tmp/tmpt21r4e'. Return Code: 1, Output: .
2019-07-30 09:25:14,322 - Stack Feature Version Info: Cluster Stack=3.1, Command Stack=None, Command Version=3.1.0.0-78 -> 3.1.0.0-78
2019-07-30 09:25:14,395 - File['/var/lib/ambari-agent/tmp/run_ca.sh'] {'owner': 'nifi', 'content': StaticFile('run_ca.sh'), 'group': 'nifi', 'mode': 0755}
2019-07-30 09:25:14,397 - Toolkit files dir is /var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/files
2019-07-30 09:25:14,397 - Toolkit tmp dir is /var/lib/ambari-agent/tmp
2019-07-30 09:25:14,399 - Directory['/var/run/nifi'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,400 - Directory['/var/lib/nifi'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,401 - Directory['/var/lib/nifi/database_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,402 - Directory['/var/lib/nifi/flowfile_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,403 - Directory['/var/lib/nifi/provenance_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,403 - Directory['/usr/hdf/current/nifi/conf'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,404 - Directory['/var/lib/nifi/conf'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,405 - Directory['/var/lib/nifi/state/local'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,405 - Directory['/usr/hdf/current/nifi/lib'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,406 - Directory['/var/lib/nifi/content_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,406 - Directory['/var/lib/nifi/content_repository'] {'owner': 'nifi', 'group': 'nifi', 'create_parents': True, 'recursive_ownership': True, 'cd_access': 'a'}
2019-07-30 09:25:14,407 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'}
2019-07-30 09:25:14,411 - File['/etc/security/limits.d/nifi.conf'] {'content': Template('nifi.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644}
2019-07-30 09:25:14,412 - Running command: /usr/hdp/current/zookeeper-client/bin/zkCli.sh -server nlddfmrvu11.mtn.co.za:2181 ls /nifi
2019-07-30 09:25:14,412 - call['/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server nlddfmrvu11.mtn.co.za:2181 ls /nifi'] {'logoutput': True, 'quiet': False, 'timeout': 20}
Connecting to nlddfmrvu11.mtn.co.za:2181
2019-07-30 09:25:14,573 - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.6-78--1, built on 12/06/2018 12:30 GMT
2019-07-30 09:25:14,575 - INFO  [main:Environment@100] - Client environment:host.name=nladfmrvu11
2019-07-30 09:25:14,575 - INFO  [main:Environment@100] - Client environment:java.version=1.8.0_202
2019-07-30 09:25:14,577 - INFO  [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2019-07-30 09:25:14,577 - INFO  [main:Environment@100] - Client environment:java.home=/usr/java/jdk1.8.0_202-amd64/jre
2019-07-30 09:25:14,577 - INFO  [main:Environment@100] - Client environment:java.class.path=/usr/hdp/current/zookeeper-client/bin/../build/classes:/usr/hdp/current/zookeeper-client/bin/../build/lib/*.jar:/usr/hdp/current/zookeeper-client/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/hdp/current/zookeeper-client/bin/../lib/slf4j-api-1.6.1.jar:/usr/hdp/current/zookeeper-client/bin/../lib/netty-3.10.5.Final.jar:/usr/hdp/current/zookeeper-client/bin/../lib/log4j-1.2.16.jar:/usr/hdp/current/zookeeper-client/bin/../lib/jline-0.9.94.jar:/usr/hdp/current/zookeeper-client/bin/../zookeeper-3.4.6.3.1.0.0-78.jar:/usr/hdp/current/zookeeper-client/bin/../src/java/lib/*.jar:/usr/hdp/current/zookeeper-client/bin/../conf::/usr/share/zookeeper/*
2019-07-30 09:25:14,577 - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2019-07-30 09:25:14,577 - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>
2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:os.name=Linux
2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:os.arch=amd64
2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:os.version=3.10.0-327.el7.x86_64
2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:user.name=root
2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:user.home=/root
2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:user.dir=/var/lib/ambari-agent
2019-07-30 09:25:14,579 - INFO  [main:ZooKeeper@438] - Initiating client connection, connectString=nlddfmrvu11.mtn.co.za:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@25f38edc
2019-07-30 09:25:14,605 - INFO  [main-SendThread(nlddfmrvu11.mtn.co.za:2181):ClientCnxn$SendThread@1019] - Opening socket connection to server nlddfmrvu11.mtn.co.za/10.20.118.166:2181. Will not attempt to authenticate using SASL (unknown error)
2019-07-30 09:25:14,665 - INFO  [main-SendThread(nlddfmrvu11.mtn.co.za:2181):ClientCnxn$SendThread@864] - Socket connection established, initiating session, client: /10.244.8.52:41984, server: nlddfmrvu11.mtn.co.za/10.20.118.166:2181
2019-07-30 09:25:14,674 - INFO  [main-SendThread(nlddfmrvu11.mtn.co.za:2181):ClientCnxn$SendThread@1279] - Session establishment complete on server nlddfmrvu11.mtn.co.za/10.20.118.166:2181, sessionid = 0x26c3e83f42101d8, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
Node does not exist: /nifi
2019-07-30 09:25:14,996 - call returned (0, 'Connecting to nlddfmrvu11.mtn.co.za:2181\n2019-07-30 09:25:14,573 - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.6-78--1, built on 12/06/2018 12:30 GMT\n2019-07-30 09:25:14,575 - INFO  [main:Environment@100] - Client environment:host.name=nladfmrvu11\n2019-07-30 09:25:14,575 - INFO  [main:Environment@100] - Client environment:java.version=1.8.0_202\n2019-07-30 09:25:14,577 - INFO  [main:Environment@100] - Client environment:java.vendor=Oracle Corporation\n2019-07-30 09:25:14,577 - INFO  [main:Environment@100] - Client environment:java.home=/usr/java/jdk1.8.0_202-amd64/jre\n2019-07-30 09:25:14,577 - INFO  [main:Environment@100] - Client environment:java.class.path=/usr/hdp/current/zookeeper-client/bin/../build/classes:/usr/hdp/current/zookeeper-client/bin/../build/lib/*.jar:/usr/hdp/current/zookeeper-client/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/hdp/current/zookeeper-client/bin/../lib/slf4j-api-1.6.1.jar:/usr/hdp/current/zookeeper-client/bin/../lib/netty-3.10.5.Final.jar:/usr/hdp/current/zookeeper-client/bin/../lib/log4j-1.2.16.jar:/usr/hdp/current/zookeeper-client/bin/../lib/jline-0.9.94.jar:/usr/hdp/current/zookeeper-client/bin/../zookeeper-3.4.6.3.1.0.0-78.jar:/usr/hdp/current/zookeeper-client/bin/../src/java/lib/*.jar:/usr/hdp/current/zookeeper-client/bin/../conf::/usr/share/zookeeper/*\n2019-07-30 09:25:14,577 - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib\n2019-07-30 09:25:14,577 - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp\n2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>\n2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:os.name=Linux\n2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:os.arch=amd64\n2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:os.version=3.10.0-327.el7.x86_64\n2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:user.name=root\n2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:user.home=/root\n2019-07-30 09:25:14,578 - INFO  [main:Environment@100] - Client environment:user.dir=/var/lib/ambari-agent\n2019-07-30 09:25:14,579 - INFO  [main:ZooKeeper@438] - Initiating client connection, connectString=nlddfmrvu11.mtn.co.za:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@25f38edc\n2019-07-30 09:25:14,605 - INFO  [main-SendThread(nlddfmrvu11.mtn.co.za:2181):ClientCnxn$SendThread@1019] - Opening socket connection to server nlddfmrvu11.mtn.co.za/10.20.118.166:2181. Will not attempt to authenticate using SASL (unknown error)\n2019-07-30 09:25:14,665 - INFO  [main-SendThread(nlddfmrvu11.mtn.co.za:2181):ClientCnxn$SendThread@864] - Socket connection established, initiating session, client: /10.244.8.52:41984, server: nlddfmrvu11.mtn.co.za/10.20.118.166:2181\n2019-07-30 09:25:14,674 - INFO  [main-SendThread(nlddfmrvu11.mtn.co.za:2181):ClientCnxn$SendThread@1279] - Session establishment complete on server nlddfmrvu11.mtn.co.za/10.20.118.166:2181, sessionid = 0x26c3e83f42101d8, negotiated timeout = 30000\n\nWATCHER::\n\nWatchedEvent state:SyncConnected type:None path:null\nNode does not exist: /nifi')
2019-07-30 09:25:14,996 - Nifi ZNode does not exist, so no pre-existing cluster.: /nifi
2019-07-30 09:25:14,997 - PropertiesFile['/usr/hdf/current/nifi/conf/nifi.properties'] {'owner': 'nifi', 'group': 'nifi', 'mode': 0600, 'properties': ...}
2019-07-30 09:25:15,003 - Generating properties file: /usr/hdf/current/nifi/conf/nifi.properties
2019-07-30 09:25:15,003 - File['/usr/hdf/current/nifi/conf/nifi.properties'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0600, 'encoding': 'UTF-8'}
2019-07-30 09:25:15,110 - Writing File['/usr/hdf/current/nifi/conf/nifi.properties'] because contents don't match
2019-07-30 09:25:15,116 - File['/usr/hdf/current/nifi/conf/bootstrap.conf'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0600}
2019-07-30 09:25:15,120 - File['/usr/hdf/current/nifi/conf/logback.xml'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0400}
2019-07-30 09:25:15,123 - File['/usr/hdf/current/nifi/conf/state-management.xml'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0400}
2019-07-30 09:25:15,132 - File['/usr/hdf/current/nifi/conf/authorizers.xml'] {'owner': 'nifi', 'content': ..., 'group': 'nifi', 'mode': 0600}
2019-07-30 09:25:15,138 - File['/usr/hdf/current/nifi/conf/login-identity-providers.xml'] {'owner': 'nifi', 'content': '<loginIdentityProviders>\n            \n            \n            \n            \n            \n            \n\n            </loginIdentityProviders>', 'group': 'nifi', 'mode': 0600}
2019-07-30 09:25:15,140 - File['/usr/hdf/current/nifi/bin/nifi-env.sh'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0755}
2019-07-30 09:25:15,143 - File['/usr/hdf/current/nifi/conf/bootstrap-notification-services.xml'] {'owner': 'nifi', 'content': '<services>\n            \n            \n\n            \n\n            \n            </services>', 'group': 'nifi', 'mode': 0400}
2019-07-30 09:25:15,162 - Skipping stack-select on NIFI because it does not exist in the stack-select package structure.

Command failed after 1 tries