2017-08-24 10:52:50,680 INFO [ZkClient-EventThread-75566-storagev4-1a:2181,storagev4-1b:2181,storagev4-1c:2181] org.I0Itec.zkclient.ZkEventThread Starting ZkClient event thread. 2017-08-24 10:52:50,685 INFO [pool-14272-thread-1-SendThread(storagev4-1c:2181)] o.a.zookeeper.client.ZooKeeperSaslClient Client will use GSSAPI as SASL mechanism. 2017-08-24 10:52:50,840 INFO [pool-14272-thread-1-EventThread] org.I0Itec.zkclient.ZkClient zookeeper state changed (SyncConnected) 2017-08-24 10:52:50,845 INFO [pool-14272-thread-1-EventThread] org.I0Itec.zkclient.ZkClient zookeeper state changed (SaslAuthenticated) 2017-08-24 10:52:50,852 INFO [ZkClient-EventThread-75566-storagev4-1a:2181,storagev4-1b:2181,storagev4-1c:2181] org.I0Itec.zkclient.ZkEventThread Terminate ZkClient event thread. 2017-08-24 10:52:50,883 INFO [pool-14272-thread-1] kafka.utils.VerifiableProperties Verifying properties 2017-08-24 10:52:50,885 INFO [pool-14272-thread-1] kafka.utils.VerifiableProperties Property auto.commit.interval.ms is overridden to 60000 2017-08-24 10:52:50,885 INFO [pool-14272-thread-1] kafka.utils.VerifiableProperties Property auto.offset.reset is overridden to largest 2017-08-24 10:52:50,885 INFO [pool-14272-thread-1] kafka.utils.VerifiableProperties Property client.id is overridden to NiFi-015d1044-8f0d-1678-3837-0325bf3bf427 2017-08-24 10:52:50,885 INFO [pool-14272-thread-1] kafka.utils.VerifiableProperties Property consumer.timeout.ms is overridden to 1 2017-08-24 10:52:50,885 INFO [pool-14272-thread-1] kafka.utils.VerifiableProperties Property group.id is overridden to test-consumer-group 2017-08-24 10:52:50,885 WARN [pool-14272-thread-1] kafka.utils.VerifiableProperties Property security.protocol is not valid 2017-08-24 10:52:50,885 INFO [pool-14272-thread-1] kafka.utils.VerifiableProperties Property socket.timeout.ms is overridden to 60000 2017-08-24 10:52:50,885 INFO [pool-14272-thread-1] kafka.utils.VerifiableProperties Property zookeeper.connect is overridden to storagev4-1a:2181,storagev4-1b:2181,storagev4-1c:2181 2017-08-24 10:52:50,885 INFO [pool-14272-thread-1] kafka.utils.VerifiableProperties Property zookeeper.connection.timeout.ms is overridden to 60000 2017-08-24 10:52:50,887 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], Connecting to zookeeper instance at storagev4-1a:2181,storagev4-1b:2181,storagev4-1c:2181 2017-08-24 10:52:50,888 INFO [ZkClient-EventThread-75569-storagev4-1a:2181,storagev4-1b:2181,storagev4-1c:2181] org.I0Itec.zkclient.ZkEventThread Starting ZkClient event thread. 2017-08-24 10:52:50,891 INFO [pool-14272-thread-1-SendThread(storagev4-1c:2181)] o.a.zookeeper.client.ZooKeeperSaslClient Client will use GSSAPI as SASL mechanism. 2017-08-24 10:52:50,896 INFO [pool-14272-thread-1-EventThread] org.I0Itec.zkclient.ZkClient zookeeper state changed (SyncConnected) 2017-08-24 10:52:50,896 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], starting auto committer every 60000 ms 2017-08-24 10:52:50,898 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], begin registering consumer test-consumer-group_storagev4-1c-1503586370887-226039a9 in ZK 2017-08-24 10:52:50,901 INFO [pool-14272-thread-1-EventThread] org.I0Itec.zkclient.ZkClient zookeeper state changed (SaslAuthenticated) 2017-08-24 10:52:50,904 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], end registering consumer test-consumer-group_storagev4-1c-1503586370887-226039a9 in ZK 2017-08-24 10:52:50,931 INFO [test-consumer-group_storagev4-1c-1503586370887-226039a9_watcher_executor] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], starting watcher executor thread for consumer test-consumer-group_storagev4-1c-1503586370887-226039a9 2017-08-24 10:52:50,933 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], begin rebalancing consumer test-consumer-group_storagev4-1c-1503586370887-226039a9 try #0 2017-08-24 10:52:50,946 INFO [pool-14272-thread-1] kafka.consumer.ConsumerFetcherManager [ConsumerFetcherManager-1503586370896] Stopping leader finder thread 2017-08-24 10:52:50,946 INFO [pool-14272-thread-1] kafka.consumer.ConsumerFetcherManager [ConsumerFetcherManager-1503586370896] Stopping all fetchers 2017-08-24 10:52:50,946 INFO [pool-14272-thread-1] kafka.consumer.ConsumerFetcherManager [ConsumerFetcherManager-1503586370896] All connections stopped 2017-08-24 10:52:50,946 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], Cleared all relevant queues for this fetcher 2017-08-24 10:52:50,946 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], Cleared the data chunks in all the consumer message iterators 2017-08-24 10:52:50,946 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], Committing all offsets after clearing the fetcher queues 2017-08-24 10:52:50,946 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], Releasing partition ownership 2017-08-24 10:52:50,951 INFO [pool-14272-thread-1] kafka.consumer.RangeAssignor Consumer test-consumer-group_storagev4-1c-1503586370887-226039a9 rebalancing the following partitions: ArrayBuffer(0) for topic indexing with consumers: List(test-consumer-group_storagev4-1c-1503586370887-226039a9-0) 2017-08-24 10:52:50,951 INFO [pool-14272-thread-1] kafka.consumer.RangeAssignor test-consumer-group_storagev4-1c-1503586370887-226039a9-0 attempting to claim partition 0 2017-08-24 10:52:50,953 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], test-consumer-group_storagev4-1c-1503586370887-226039a9-0 successfully owned partition 0 for topic indexing 2017-08-24 10:52:50,954 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], Consumer test-consumer-group_storagev4-1c-1503586370887-226039a9 selected partitions : indexing:0: fetched offset = 1719956: consumed offset = 1719956 2017-08-24 10:52:50,955 INFO [pool-14272-thread-1] k.consumer.ZookeeperConsumerConnector [test-consumer-group_storagev4-1c-1503586370887-226039a9], end rebalancing consumer test-consumer-group_storagev4-1c-1503586370887-226039a9 try #0 2017-08-24 10:52:50,956 INFO [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread] k.c.ConsumerFetcherManager$LeaderFinderThread [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread], Starting 2017-08-24 10:52:50,962 WARN [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread] k.c.ConsumerFetcherManager$LeaderFinderThread [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread], Failed to find leader for Set([indexing,0]) java.lang.NullPointerException: null 2017-08-24 10:52:50,962 INFO [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread] kafka.consumer.ConsumerFetcherManager [ConsumerFetcherManager-1503586370896] Added fetcher for partitions ArrayBuffer() 2017-08-24 10:52:51,168 WARN [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread] k.c.ConsumerFetcherManager$LeaderFinderThread [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread], Failed to find leader for Set([indexing,0]) java.lang.NullPointerException: null 2017-08-24 10:52:51,169 INFO [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread] kafka.consumer.ConsumerFetcherManager [ConsumerFetcherManager-1503586370896] Added fetcher for partitions ArrayBuffer() 2017-08-24 10:52:51,375 WARN [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread] k.c.ConsumerFetcherManager$LeaderFinderThread [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread], Failed to find leader for Set([indexing,0]) java.lang.NullPointerException: null 2017-08-24 10:52:51,375 INFO [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread] kafka.consumer.ConsumerFetcherManager [ConsumerFetcherManager-1503586370896] Added fetcher for partitions ArrayBuffer() 2017-08-24 10:52:51,581 WARN [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread] k.c.ConsumerFetcherManager$LeaderFinderThread [test-consumer-group_storagev4-1c-1503586370887-226039a9-leader-finder-thread], Failed to find leader for Set([indexing,0]) java.lang.NullPointerException: null