2017-06-14 01:01:42,703 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20052ms, replay=1ops 2017-06-14 01:01:42,712 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:01:47,678 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:01:47,678 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=18/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20082ms, replay=1ops 2017-06-14 01:01:48,034 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=19/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20140ms, replay=100ops 2017-06-14 01:01:48,042 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:01:48,559 INFO [hconnection-0x38d6795b-shared--pool21-t12945] client.AsyncProcess: #1011981698, table=ORMOverview, attempt=29/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20129ms, replay=100ops 2017-06-14 01:01:48,568 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1011981698, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:02:02,756 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=25/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20059ms, replay=1ops 2017-06-14 01:02:02,765 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:02:07,762 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=19/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20119ms, replay=1ops 2017-06-14 01:02:07,764 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:02:08,176 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=20/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20075ms, replay=100ops 2017-06-14 01:02:08,178 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:02:08,690 INFO [hconnection-0x38d6795b-shared--pool21-t12945] client.AsyncProcess: #1011981698, table=ORMOverview, attempt=30/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20112ms, replay=100ops 2017-06-14 01:02:08,693 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1011981698, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:02:18,620 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:02:22,817 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=26/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20039ms, replay=1ops 2017-06-14 01:02:22,819 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:02:27,882 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20175ms, replay=1ops 2017-06-14 01:02:27,887 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:02:28,253 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=21/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20124ms, replay=100ops 2017-06-14 01:02:28,259 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:02:28,710 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=10/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10056ms, replay=100ops 2017-06-14 01:02:28,715 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:02:28,803 INFO [hconnection-0x38d6795b-shared--pool21-t12945] client.AsyncProcess: #1011981698, table=ORMOverview, attempt=31/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20090ms, replay=100ops 2017-06-14 01:02:28,806 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1011981698, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:02:38,768 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=11/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10045ms, replay=100ops 2017-06-14 01:02:38,773 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:02:42,857 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=27/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20128ms, replay=1ops 2017-06-14 01:02:42,859 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:02:48,059 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20161ms, replay=1ops 2017-06-14 01:02:48,060 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:02:48,379 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=22/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20085ms, replay=100ops 2017-06-14 01:02:48,388 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:02:48,814 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:02:48,815 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=12/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20133ms, replay=100ops 2017-06-14 01:02:48,895 INFO [hconnection-0x38d6795b-shared--pool21-t12945] client.AsyncProcess: #1011981698, table=ORMOverview, attempt=32/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20148ms, replay=100ops 2017-06-14 01:02:48,895 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1011981698, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:03:02,987 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20052ms, replay=1ops 2017-06-14 01:03:02,995 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:03:08,221 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20000ms, replay=1ops 2017-06-14 01:03:08,230 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:03:08,466 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=23/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20190ms, replay=100ops 2017-06-14 01:03:08,474 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:03:08,949 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=13/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20143ms, replay=100ops 2017-06-14 01:03:08,957 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:03:09,044 INFO [hconnection-0x38d6795b-shared--pool21-t12945] client.AsyncProcess: #1011981698, table=ORMOverview, attempt=33/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20068ms, replay=100ops 2017-06-14 01:03:09,049 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1011981698, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:03:23,040 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20027ms, replay=1ops 2017-06-14 01:03:23,043 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:03:28,223 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20039ms, replay=1ops 2017-06-14 01:03:28,232 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:03:28,657 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=24/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20001ms, replay=100ops 2017-06-14 01:03:28,666 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:03:29,094 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=14/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20089ms, replay=100ops 2017-06-14 01:03:29,098 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:03:29,114 INFO [hconnection-0x38d6795b-shared--pool21-t12945] client.AsyncProcess: #1011981698, table=ORMOverview, attempt=34/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20025ms, replay=100ops 2017-06-14 01:03:29,120 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1011981698, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:03:43,069 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=30/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20002ms, replay=1ops 2017-06-14 01:03:43,075 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:03:48,263 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20115ms, replay=1ops 2017-06-14 01:03:48,263 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:03:48,661 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=25/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20138ms, replay=100ops 2017-06-14 01:03:48,668 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:03:49,140 INFO [hconnection-0x38d6795b-shared--pool21-t12945] client.AsyncProcess: #1011981698, table=ORMOverview, attempt=35/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20125ms, replay=100ops 2017-06-14 01:03:49,143 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1011981698, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:03:49,184 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=15/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20123ms, replay=100ops 2017-06-14 01:03:49,185 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:04:03,073 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=31/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20079ms, replay=1ops 2017-06-14 01:04:03,079 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:04:08,380 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20124ms, replay=1ops 2017-06-14 01:04:08,386 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:04:08,800 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=26/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20123ms, replay=100ops 2017-06-14 01:04:08,810 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:04:09,267 WARN [hconnection-0x38d6795b-shared--pool21-t12945] client.AsyncProcess: #1011981698, table=ORMOverview, attempt=36/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 00:55:18 GMT 2017; not retrying 100 - final failure 2017-06-14 01:04:09,309 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=16/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20138ms, replay=100ops 2017-06-14 01:04:09,317 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:04:23,153 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=32/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20139ms, replay=1ops 2017-06-14 01:04:23,161 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:04:28,505 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=26/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20083ms, replay=1ops 2017-06-14 01:04:28,512 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:04:28,925 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=27/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20022ms, replay=100ops 2017-06-14 01:04:28,928 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:04:29,449 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=17/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20086ms, replay=100ops 2017-06-14 01:04:29,453 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:04:43,294 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=33/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20075ms, replay=1ops 2017-06-14 01:04:43,302 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:04:48,590 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=27/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20039ms, replay=1ops 2017-06-14 01:04:48,592 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:04:48,949 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=28/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20022ms, replay=100ops 2017-06-14 01:04:48,958 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:04:49,536 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=18/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20052ms, replay=100ops 2017-06-14 01:04:49,541 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:05:03,370 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=34/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20007ms, replay=1ops 2017-06-14 01:05:03,374 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:05:08,630 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20095ms, replay=1ops 2017-06-14 01:05:08,635 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:05:08,973 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=29/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20104ms, replay=100ops 2017-06-14 01:05:08,980 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:05:09,590 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=19/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20150ms, replay=100ops 2017-06-14 01:05:09,591 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:05:23,379 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=35/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20188ms, replay=1ops 2017-06-14 01:05:23,383 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:05:28,726 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=29/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20180ms, replay=1ops 2017-06-14 01:05:28,727 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:05:29,079 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=30/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20111ms, replay=100ops 2017-06-14 01:05:29,080 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:05:29,742 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=20/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20184ms, replay=100ops 2017-06-14 01:05:29,747 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:05:38,724 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:05:43,568 INFO [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=36/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20167ms, replay=1ops 2017-06-14 01:05:43,577 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:05:48,731 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=10/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10067ms, replay=100ops 2017-06-14 01:05:48,738 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:05:48,908 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=30/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20028ms, replay=1ops 2017-06-14 01:05:48,909 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:05:49,192 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=31/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20183ms, replay=100ops 2017-06-14 01:05:49,192 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:05:49,928 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=21/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20154ms, replay=100ops 2017-06-14 01:05:49,928 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:05:58,800 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=11/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10043ms, replay=100ops 2017-06-14 01:05:58,806 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:06:03,737 WARN [hconnection-0x38d6795b-shared--pool21-t13065] client.AsyncProcess: #1011982814, table=SocialMediaInsights_New, attempt=37/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 00:56:53 GMT 2017; not retrying 1 - final failure 2017-06-14 01:06:03,737 INFO [556058799@qtp-2079565272-313726] client.AsyncProcess: #1011982814, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:06:05,282 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:06:08,845 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=12/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20118ms, replay=100ops 2017-06-14 01:06:08,847 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:06:08,936 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=31/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20153ms, replay=1ops 2017-06-14 01:06:08,938 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:06:09,377 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=32/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20095ms, replay=100ops 2017-06-14 01:06:09,382 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:06:10,084 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=22/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20150ms, replay=100ops 2017-06-14 01:06:10,090 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:06:15,299 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=10/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10064ms, replay=1ops 2017-06-14 01:06:15,307 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:06:25,365 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=11/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10056ms, replay=1ops 2017-06-14 01:06:25,370 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:06:28,965 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=13/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20008ms, replay=100ops 2017-06-14 01:06:28,966 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:06:29,090 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=32/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20106ms, replay=1ops 2017-06-14 01:06:29,094 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:06:29,474 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=33/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20036ms, replay=100ops 2017-06-14 01:06:29,476 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:06:30,236 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=23/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20143ms, replay=100ops 2017-06-14 01:06:30,244 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:06:35,422 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:06:35,422 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=12/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20026ms, replay=1ops 2017-06-14 01:06:48,975 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=14/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20114ms, replay=100ops 2017-06-14 01:06:48,978 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:06:49,197 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=33/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20045ms, replay=1ops 2017-06-14 01:06:49,201 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:06:49,511 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=34/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20110ms, replay=100ops 2017-06-14 01:06:49,514 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:06:50,381 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=24/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20168ms, replay=100ops 2017-06-14 01:06:50,383 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:06:55,289 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:06:55,449 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=13/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20162ms, replay=1ops 2017-06-14 01:06:55,458 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:07:05,381 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=10/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10025ms, replay=1ops 2017-06-14 01:07:05,390 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:07:09,091 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=15/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20156ms, replay=100ops 2017-06-14 01:07:09,099 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:07:09,244 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=34/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20129ms, replay=1ops 2017-06-14 01:07:09,245 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:07:09,623 INFO [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=35/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20177ms, replay=100ops 2017-06-14 01:07:09,624 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:07:10,551 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=25/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20174ms, replay=100ops 2017-06-14 01:07:10,553 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:07:15,408 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=11/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10039ms, replay=1ops 2017-06-14 01:07:15,415 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:07:15,613 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=14/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20178ms, replay=1ops 2017-06-14 01:07:15,621 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:07:25,448 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=12/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20101ms, replay=1ops 2017-06-14 01:07:25,457 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:07:29,249 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=16/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20171ms, replay=100ops 2017-06-14 01:07:29,254 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:07:29,374 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=35/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20187ms, replay=1ops 2017-06-14 01:07:29,374 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:07:29,802 WARN [hconnection-0x38d6795b-shared--pool21-t12962] client.AsyncProcess: #1011983389, table=ORMOverview, attempt=36/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 00:58:38 GMT 2017; not retrying 100 - final failure 2017-06-14 01:07:29,802 INFO [1424421252@qtp-2079565272-313730] client.AsyncProcess: #1011983389, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:07:30,726 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=26/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20073ms, replay=100ops 2017-06-14 01:07:30,734 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:07:35,792 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=15/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20061ms, replay=1ops 2017-06-14 01:07:35,800 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:07:45,551 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=13/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20035ms, replay=1ops 2017-06-14 01:07:45,559 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:07:49,422 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=17/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20159ms, replay=100ops 2017-06-14 01:07:49,426 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:07:49,562 INFO [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=36/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20020ms, replay=1ops 2017-06-14 01:07:49,566 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:07:50,801 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=27/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20089ms, replay=100ops 2017-06-14 01:07:50,807 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:07:55,855 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=16/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20161ms, replay=1ops 2017-06-14 01:07:55,860 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:08:05,587 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=14/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20154ms, replay=1ops 2017-06-14 01:08:05,591 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:08:09,583 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=18/35 failed=100ops, last exception: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: This connection is closing on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20181ms, replay=100ops 2017-06-14 01:08:09,583 WARN [hconnection-0x38d6795b-shared--pool21-t13041] client.AsyncProcess: #1011984002, table=SocialMediaInsights_New, attempt=37/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 00:58:58 GMT 2017; not retrying 1 - final failure 2017-06-14 01:08:09,583 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1011984002, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:08:09,594 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:08:10,892 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=28/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20118ms, replay=100ops 2017-06-14 01:08:10,896 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:08:16,017 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=17/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20007ms, replay=1ops 2017-06-14 01:08:16,026 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:08:25,743 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=15/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20028ms, replay=1ops 2017-06-14 01:08:25,747 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:08:29,766 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=19/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20058ms, replay=100ops 2017-06-14 01:08:29,773 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:08:31,012 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=29/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20127ms, replay=100ops 2017-06-14 01:08:31,017 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:08:36,026 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=18/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20113ms, replay=1ops 2017-06-14 01:08:36,026 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:08:45,772 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=16/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20168ms, replay=1ops 2017-06-14 01:08:45,781 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:08:49,826 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=20/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20078ms, replay=100ops 2017-06-14 01:08:49,828 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:08:51,141 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=30/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20089ms, replay=100ops 2017-06-14 01:08:51,145 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:08:56,140 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=19/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20067ms, replay=1ops 2017-06-14 01:08:56,141 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:08:57,412 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:08:58,778 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:09:05,942 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=17/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20048ms, replay=1ops 2017-06-14 01:09:05,944 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:09:07,434 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=10/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10098ms, replay=1ops 2017-06-14 01:09:07,442 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:09:08,846 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:09:08,846 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=10/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10057ms, replay=100ops 2017-06-14 01:09:09,905 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=21/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20051ms, replay=100ops 2017-06-14 01:09:09,910 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:09:11,232 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=31/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20079ms, replay=100ops 2017-06-14 01:09:11,236 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:09:16,209 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20176ms, replay=1ops 2017-06-14 01:09:16,213 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:09:17,533 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=11/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10008ms, replay=1ops 2017-06-14 01:09:17,535 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:09:18,905 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=11/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10024ms, replay=100ops 2017-06-14 01:09:18,908 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:09:25,994 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=18/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20186ms, replay=1ops 2017-06-14 01:09:25,998 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:09:27,542 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=12/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20044ms, replay=1ops 2017-06-14 01:09:27,543 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:09:28,931 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=12/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20138ms, replay=100ops 2017-06-14 01:09:28,934 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:09:29,958 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=22/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20042ms, replay=100ops 2017-06-14 01:09:29,960 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:09:31,313 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=32/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20061ms, replay=100ops 2017-06-14 01:09:31,321 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:09:36,386 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20176ms, replay=1ops 2017-06-14 01:09:36,390 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:09:46,181 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=19/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20170ms, replay=1ops 2017-06-14 01:09:46,187 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:09:47,588 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=13/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20126ms, replay=1ops 2017-06-14 01:09:47,597 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:09:49,070 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=13/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20123ms, replay=100ops 2017-06-14 01:09:49,072 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:09:50,002 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:09:50,002 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=23/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20062ms, replay=100ops 2017-06-14 01:09:51,375 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:09:51,376 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=33/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20036ms, replay=100ops 2017-06-14 01:09:56,564 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20101ms, replay=1ops 2017-06-14 01:09:56,572 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:10:06,353 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20159ms, replay=1ops 2017-06-14 01:10:06,360 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:10:07,715 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=14/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20067ms, replay=1ops 2017-06-14 01:10:07,717 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:10:09,195 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=14/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20095ms, replay=100ops 2017-06-14 01:10:09,198 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:10:10,065 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=24/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20066ms, replay=100ops 2017-06-14 01:10:10,066 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:10:11,414 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=34/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20064ms, replay=100ops 2017-06-14 01:10:11,417 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:10:16,666 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20178ms, replay=1ops 2017-06-14 01:10:16,675 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:10:26,513 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20086ms, replay=1ops 2017-06-14 01:10:26,515 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:10:27,783 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=15/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20182ms, replay=1ops 2017-06-14 01:10:27,788 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:10:29,292 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=15/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20175ms, replay=100ops 2017-06-14 01:10:29,299 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:10:30,133 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=25/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20019ms, replay=100ops 2017-06-14 01:10:30,141 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:10:31,481 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=35/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20171ms, replay=100ops 2017-06-14 01:10:31,482 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:10:36,846 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20140ms, replay=1ops 2017-06-14 01:10:36,849 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:10:46,601 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20119ms, replay=1ops 2017-06-14 01:10:46,606 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:10:47,966 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=16/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20141ms, replay=1ops 2017-06-14 01:10:47,973 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:10:49,469 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=16/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20003ms, replay=100ops 2017-06-14 01:10:49,469 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:10:50,154 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=26/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20119ms, replay=100ops 2017-06-14 01:10:50,157 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:10:51,654 WARN [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1011988369, table=ORMOverview, attempt=36/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:02:00 GMT 2017; not retrying 100 - final failure 2017-06-14 01:10:51,654 INFO [362644631@qtp-2079565272-313724] client.AsyncProcess: #1011988369, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:10:56,987 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20192ms, replay=1ops 2017-06-14 01:10:56,992 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:11:06,722 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20043ms, replay=1ops 2017-06-14 01:11:06,723 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:11:08,108 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=17/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20026ms, replay=1ops 2017-06-14 01:11:08,111 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:11:09,473 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=17/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20034ms, replay=100ops 2017-06-14 01:11:09,477 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:11:10,274 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=27/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20056ms, replay=100ops 2017-06-14 01:11:10,276 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:11:17,181 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=26/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20070ms, replay=1ops 2017-06-14 01:11:17,187 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:11:26,766 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20001ms, replay=1ops 2017-06-14 01:11:26,771 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:11:28,135 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=18/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20017ms, replay=1ops 2017-06-14 01:11:28,137 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:11:29,509 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=18/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20117ms, replay=100ops 2017-06-14 01:11:29,511 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:11:30,332 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=28/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20041ms, replay=100ops 2017-06-14 01:11:30,336 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:11:37,252 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:11:37,252 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=27/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20099ms, replay=1ops 2017-06-14 01:11:46,768 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:11:46,769 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20149ms, replay=1ops 2017-06-14 01:11:48,153 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=19/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20065ms, replay=1ops 2017-06-14 01:11:48,160 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:11:49,628 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=19/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20152ms, replay=100ops 2017-06-14 01:11:49,637 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:11:50,374 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=29/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20190ms, replay=100ops 2017-06-14 01:11:50,383 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:11:57,353 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20042ms, replay=1ops 2017-06-14 01:11:57,361 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:12:06,919 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=26/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20026ms, replay=1ops 2017-06-14 01:12:06,921 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:12:08,220 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20188ms, replay=1ops 2017-06-14 01:12:08,228 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:12:09,781 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=20/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20085ms, replay=100ops 2017-06-14 01:12:09,782 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:12:10,566 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=30/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20015ms, replay=100ops 2017-06-14 01:12:10,575 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:12:17,396 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20030ms, replay=1ops 2017-06-14 01:12:17,400 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:12:20,094 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:12:26,946 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:12:26,947 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=27/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20158ms, replay=1ops 2017-06-14 01:12:28,409 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=21/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20044ms, replay=1ops 2017-06-14 01:12:28,415 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:12:29,868 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:12:29,868 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=21/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20082ms, replay=100ops 2017-06-14 01:12:30,119 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=10/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10082ms, replay=100ops 2017-06-14 01:12:30,129 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:12:30,583 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:12:30,583 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=31/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20029ms, replay=100ops 2017-06-14 01:12:37,428 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=30/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20164ms, replay=1ops 2017-06-14 01:12:37,436 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:12:40,203 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=11/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10019ms, replay=100ops 2017-06-14 01:12:40,207 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:12:47,106 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20041ms, replay=1ops 2017-06-14 01:12:47,114 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:12:48,454 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=22/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20078ms, replay=1ops 2017-06-14 01:12:48,457 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:12:49,953 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=22/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20159ms, replay=100ops 2017-06-14 01:12:49,960 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:12:50,224 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=12/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20193ms, replay=100ops 2017-06-14 01:12:50,233 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:12:50,614 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=32/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20183ms, replay=100ops 2017-06-14 01:12:50,622 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:12:57,594 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=31/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20179ms, replay=1ops 2017-06-14 01:12:57,600 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:13:07,148 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20044ms, replay=1ops 2017-06-14 01:13:07,149 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:13:08,533 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=23/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20095ms, replay=1ops 2017-06-14 01:13:08,542 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:13:10,114 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=23/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20089ms, replay=100ops 2017-06-14 01:13:10,118 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:13:10,418 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:13:10,418 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=13/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20080ms, replay=100ops 2017-06-14 01:13:10,798 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=33/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20018ms, replay=100ops 2017-06-14 01:13:10,799 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:13:17,774 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=32/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20170ms, replay=1ops 2017-06-14 01:13:17,776 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:13:27,194 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=30/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20175ms, replay=1ops 2017-06-14 01:13:27,202 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:13:28,630 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=24/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20069ms, replay=1ops 2017-06-14 01:13:28,632 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:13:30,205 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=24/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20189ms, replay=100ops 2017-06-14 01:13:30,210 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:13:30,500 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=14/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20052ms, replay=100ops 2017-06-14 01:13:30,507 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:13:30,818 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=34/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20036ms, replay=100ops 2017-06-14 01:13:30,826 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:13:37,946 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=33/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20177ms, replay=1ops 2017-06-14 01:13:37,948 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:13:47,371 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:13:47,371 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=31/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20104ms, replay=1ops 2017-06-14 01:13:48,700 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=25/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20008ms, replay=1ops 2017-06-14 01:13:48,703 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:13:50,396 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=25/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20160ms, replay=100ops 2017-06-14 01:13:50,400 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:13:50,553 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=15/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20114ms, replay=100ops 2017-06-14 01:13:50,561 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:13:50,856 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=35/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20191ms, replay=100ops 2017-06-14 01:13:50,864 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:13:58,124 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=34/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20196ms, replay=1ops 2017-06-14 01:13:58,131 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:14:07,476 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:14:07,476 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=32/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20067ms, replay=1ops 2017-06-14 01:14:08,709 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=26/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20062ms, replay=1ops 2017-06-14 01:14:08,718 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:14:10,558 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=26/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20076ms, replay=100ops 2017-06-14 01:14:10,566 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:14:10,669 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=16/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20102ms, replay=100ops 2017-06-14 01:14:10,674 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:14:11,049 INFO [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=36/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20181ms, replay=100ops 2017-06-14 01:14:11,051 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:14:18,322 INFO [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=35/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20091ms, replay=1ops 2017-06-14 01:14:18,326 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:14:27,545 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=33/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20198ms, replay=1ops 2017-06-14 01:14:27,549 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:14:28,772 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=27/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20059ms, replay=1ops 2017-06-14 01:14:28,781 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:14:30,635 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=27/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20033ms, replay=100ops 2017-06-14 01:14:30,642 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:14:30,773 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=17/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20170ms, replay=100ops 2017-06-14 01:14:30,773 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:14:31,232 WARN [hconnection-0x38d6795b-shared--pool21-t12953] client.AsyncProcess: #1012004816, table=ORMOverview, attempt=37/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:05:20 GMT 2017; not retrying 100 - final failure 2017-06-14 01:14:31,232 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012004816, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:14:38,414 WARN [hconnection-0x38d6795b-shared--pool21-t13102] client.AsyncProcess: #1012006451, table=CampaignFactsByLinkClicksMDC, attempt=36/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:05:47 GMT 2017; not retrying 1 - final failure 2017-06-14 01:14:38,414 INFO [1165122166@qtp-2079565272-313728] client.AsyncProcess: #1012006451, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:14:46,082 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:14:47,744 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=34/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20133ms, replay=1ops 2017-06-14 01:14:47,750 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:14:48,833 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20173ms, replay=1ops 2017-06-14 01:14:48,833 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:14:50,670 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=28/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20195ms, replay=100ops 2017-06-14 01:14:50,678 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:14:50,944 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=18/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20181ms, replay=100ops 2017-06-14 01:14:50,947 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:14:56,172 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=10/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10012ms, replay=1ops 2017-06-14 01:14:56,175 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:15:06,186 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=11/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10079ms, replay=1ops 2017-06-14 01:15:06,194 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:15:07,878 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:15:07,878 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=35/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20093ms, replay=1ops 2017-06-14 01:15:09,007 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20088ms, replay=1ops 2017-06-14 01:15:09,009 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:15:10,866 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=29/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20152ms, replay=100ops 2017-06-14 01:15:10,875 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:15:11,127 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=19/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20090ms, replay=100ops 2017-06-14 01:15:11,129 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:15:16,266 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=12/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20023ms, replay=1ops 2017-06-14 01:15:16,270 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:15:27,973 INFO [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=36/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20067ms, replay=1ops 2017-06-14 01:15:27,981 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:15:29,096 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=30/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20077ms, replay=1ops 2017-06-14 01:15:29,096 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:15:31,020 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=30/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20081ms, replay=100ops 2017-06-14 01:15:31,023 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:15:31,219 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=20/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20008ms, replay=100ops 2017-06-14 01:15:31,219 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:15:36,290 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=13/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20122ms, replay=1ops 2017-06-14 01:15:36,291 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:15:48,043 WARN [hconnection-0x38d6795b-shared--pool21-t12902] client.AsyncProcess: #1012009040, table=CampaignFactsByLinkClicksMDC, attempt=37/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:06:37 GMT 2017; not retrying 1 - final failure 2017-06-14 01:15:48,044 INFO [1570983467@qtp-2079565272-313734] client.AsyncProcess: #1012009040, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:15:49,174 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=31/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20071ms, replay=1ops 2017-06-14 01:15:49,183 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:15:51,103 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=31/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20148ms, replay=100ops 2017-06-14 01:15:51,112 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:15:51,228 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=21/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20052ms, replay=100ops 2017-06-14 01:15:51,230 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:15:56,414 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=14/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20055ms, replay=1ops 2017-06-14 01:15:56,423 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:16:07,638 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:16:09,012 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:16:09,246 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=32/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20086ms, replay=1ops 2017-06-14 01:16:09,253 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:16:11,253 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=32/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20064ms, replay=100ops 2017-06-14 01:16:11,260 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:16:11,282 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=22/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20070ms, replay=100ops 2017-06-14 01:16:11,287 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:16:16,470 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=15/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20105ms, replay=1ops 2017-06-14 01:16:16,475 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:16:17,727 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=10/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10009ms, replay=1ops 2017-06-14 01:16:17,736 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:16:19,050 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=10/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10039ms, replay=100ops 2017-06-14 01:16:19,059 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:16:27,737 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=11/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10042ms, replay=1ops 2017-06-14 01:16:27,747 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:16:29,090 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=11/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10027ms, replay=100ops 2017-06-14 01:16:29,098 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:16:29,333 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=33/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20046ms, replay=1ops 2017-06-14 01:16:29,340 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:16:31,318 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=33/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20197ms, replay=100ops 2017-06-14 01:16:31,320 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:16:31,353 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=23/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20180ms, replay=100ops 2017-06-14 01:16:31,358 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:16:36,576 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=16/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20057ms, replay=1ops 2017-06-14 01:16:36,585 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:16:37,781 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=12/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20129ms, replay=1ops 2017-06-14 01:16:37,790 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:16:39,119 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=12/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20020ms, replay=100ops 2017-06-14 01:16:39,123 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:16:49,381 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=34/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20061ms, replay=1ops 2017-06-14 01:16:49,382 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:16:51,517 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=34/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20012ms, replay=100ops 2017-06-14 01:16:51,524 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:16:51,534 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=24/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20019ms, replay=100ops 2017-06-14 01:16:51,543 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:16:56,635 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=17/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20033ms, replay=1ops 2017-06-14 01:16:56,644 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:16:57,911 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=13/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20021ms, replay=1ops 2017-06-14 01:16:57,913 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:16:59,141 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=13/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20106ms, replay=100ops 2017-06-14 01:16:59,143 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:17:09,443 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=35/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20130ms, replay=1ops 2017-06-14 01:17:09,448 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:17:11,420 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:17:11,531 INFO [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=35/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20056ms, replay=100ops 2017-06-14 01:17:11,538 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:17:11,555 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=25/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20060ms, replay=100ops 2017-06-14 01:17:11,557 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:17:16,669 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=18/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20141ms, replay=1ops 2017-06-14 01:17:16,670 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:17:17,933 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=14/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20175ms, replay=1ops 2017-06-14 01:17:17,938 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:17:19,249 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=14/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20179ms, replay=100ops 2017-06-14 01:17:19,249 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:17:21,438 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=10/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10034ms, replay=1ops 2017-06-14 01:17:21,444 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:17:29,575 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:17:29,575 INFO [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=36/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20171ms, replay=1ops 2017-06-14 01:17:31,473 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=11/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10081ms, replay=1ops 2017-06-14 01:17:31,482 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:17:31,589 WARN [hconnection-0x38d6795b-shared--pool21-t12941] client.AsyncProcess: #1012012904, table=ORMOverview, attempt=36/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:08:40 GMT 2017; not retrying 100 - final failure 2017-06-14 01:17:31,589 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012012904, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:17:31,616 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=26/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20100ms, replay=100ops 2017-06-14 01:17:31,620 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:17:36,812 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:17:36,812 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=19/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20136ms, replay=1ops 2017-06-14 01:17:38,109 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=15/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20117ms, replay=1ops 2017-06-14 01:17:38,113 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:17:39,429 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=15/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20143ms, replay=100ops 2017-06-14 01:17:39,437 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:17:41,555 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=12/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20073ms, replay=1ops 2017-06-14 01:17:41,564 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:17:49,748 WARN [hconnection-0x38d6795b-shared--pool21-t12924] client.AsyncProcess: #1012012872, table=CampaignFactsByLinkClicksMDC, attempt=37/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:08:39 GMT 2017; not retrying 1 - final failure 2017-06-14 01:17:49,748 INFO [672315155@qtp-2079565272-313738] client.AsyncProcess: #1012012872, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:17:51,718 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=27/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20166ms, replay=100ops 2017-06-14 01:17:51,725 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:17:56,949 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20099ms, replay=1ops 2017-06-14 01:17:56,956 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:17:58,227 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=16/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20118ms, replay=1ops 2017-06-14 01:17:58,227 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:17:59,574 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=16/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20039ms, replay=100ops 2017-06-14 01:17:59,582 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:18:01,630 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=13/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20183ms, replay=1ops 2017-06-14 01:18:01,638 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:18:11,886 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=28/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20014ms, replay=100ops 2017-06-14 01:18:11,892 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:18:17,050 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20090ms, replay=1ops 2017-06-14 01:18:17,051 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:18:18,347 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=17/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20177ms, replay=1ops 2017-06-14 01:18:18,354 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:18:19,615 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=17/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20052ms, replay=100ops 2017-06-14 01:18:19,621 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:18:21,814 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=14/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20103ms, replay=1ops 2017-06-14 01:18:21,822 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:18:31,902 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=29/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20105ms, replay=100ops 2017-06-14 01:18:31,910 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:18:37,141 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20147ms, replay=1ops 2017-06-14 01:18:37,146 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:18:38,525 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=18/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20102ms, replay=1ops 2017-06-14 01:18:38,526 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:18:39,669 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=18/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20152ms, replay=100ops 2017-06-14 01:18:39,678 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:18:41,919 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=15/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20104ms, replay=1ops 2017-06-14 01:18:41,920 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:18:52,009 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=30/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20161ms, replay=100ops 2017-06-14 01:18:52,011 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:18:57,290 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20169ms, replay=1ops 2017-06-14 01:18:57,291 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:18:58,628 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=19/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20106ms, replay=1ops 2017-06-14 01:18:58,634 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:18:59,823 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=19/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20024ms, replay=100ops 2017-06-14 01:18:59,826 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:19:02,024 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=16/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20100ms, replay=1ops 2017-06-14 01:19:02,026 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:19:12,172 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=31/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20071ms, replay=100ops 2017-06-14 01:19:12,177 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:19:17,460 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20024ms, replay=1ops 2017-06-14 01:19:17,468 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:19:18,735 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=20/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20010ms, replay=1ops 2017-06-14 01:19:18,741 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:19:19,849 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=20/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20116ms, replay=100ops 2017-06-14 01:19:19,851 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:19:22,126 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=17/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20153ms, replay=1ops 2017-06-14 01:19:22,132 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:19:29,525 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:19:32,245 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=32/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20078ms, replay=100ops 2017-06-14 01:19:32,245 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:19:37,485 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:19:37,486 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20162ms, replay=1ops 2017-06-14 01:19:38,747 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=21/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20103ms, replay=1ops 2017-06-14 01:19:38,751 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:19:39,582 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=10/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10067ms, replay=100ops 2017-06-14 01:19:39,582 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:19:39,967 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=21/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20129ms, replay=100ops 2017-06-14 01:19:39,975 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:19:42,280 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=18/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20002ms, replay=1ops 2017-06-14 01:19:42,286 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:19:49,650 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:19:49,650 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=11/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10022ms, replay=100ops 2017-06-14 01:19:52,324 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=33/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20179ms, replay=100ops 2017-06-14 01:19:52,325 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:19:57,649 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=26/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20110ms, replay=1ops 2017-06-14 01:19:57,656 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:19:58,851 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20096ms, replay=1ops 2017-06-14 01:19:58,857 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:19:59,674 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=12/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20081ms, replay=100ops 2017-06-14 01:19:59,674 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:20:00,097 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=22/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20103ms, replay=100ops 2017-06-14 01:20:00,101 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:20:02,283 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=19/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20149ms, replay=1ops 2017-06-14 01:20:02,292 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:20:05,988 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:20:12,505 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=34/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20056ms, replay=100ops 2017-06-14 01:20:12,508 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:20:16,079 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=10/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10061ms, replay=1ops 2017-06-14 01:20:16,086 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:20:17,760 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=27/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20190ms, replay=1ops 2017-06-14 01:20:17,763 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:20:18,948 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20168ms, replay=1ops 2017-06-14 01:20:18,952 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:20:19,756 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=13/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20104ms, replay=100ops 2017-06-14 01:20:19,759 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:20:20,201 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=23/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20177ms, replay=100ops 2017-06-14 01:20:20,211 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:20:22,434 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20176ms, replay=1ops 2017-06-14 01:20:22,436 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:20:26,141 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=11/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10052ms, replay=1ops 2017-06-14 01:20:26,146 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:20:32,564 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=35/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20114ms, replay=100ops 2017-06-14 01:20:32,570 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:20:36,195 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=12/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20035ms, replay=1ops 2017-06-14 01:20:36,198 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:20:37,951 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=28/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20027ms, replay=1ops 2017-06-14 01:20:37,953 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:20:39,118 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20011ms, replay=1ops 2017-06-14 01:20:39,122 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:20:39,862 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=14/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20109ms, replay=100ops 2017-06-14 01:20:39,871 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:20:40,380 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=24/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20147ms, replay=100ops 2017-06-14 01:20:40,388 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:20:42,611 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20101ms, replay=1ops 2017-06-14 01:20:42,618 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:20:52,680 INFO [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=36/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20145ms, replay=100ops 2017-06-14 01:20:52,687 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:20:56,231 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=13/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20101ms, replay=1ops 2017-06-14 01:20:56,238 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:20:57,979 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=29/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20117ms, replay=1ops 2017-06-14 01:20:57,984 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:20:59,130 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20071ms, replay=1ops 2017-06-14 01:20:59,139 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:20:59,973 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=15/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20191ms, replay=100ops 2017-06-14 01:20:59,977 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:21:00,528 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=25/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20080ms, replay=100ops 2017-06-14 01:21:00,532 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:21:02,713 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:21:02,714 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20054ms, replay=1ops 2017-06-14 01:21:12,827 WARN [hconnection-0x38d6795b-shared--pool21-t12986] client.AsyncProcess: #1012020012, table=ORMDetails, attempt=37/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:12:01 GMT 2017; not retrying 100 - final failure 2017-06-14 01:21:12,827 INFO [1891485855@qtp-2079565272-313740] client.AsyncProcess: #1012020012, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:21:16,334 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=14/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20047ms, replay=1ops 2017-06-14 01:21:16,338 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:21:18,097 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=30/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20013ms, replay=1ops 2017-06-14 01:21:18,098 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:21:19,203 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=26/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20089ms, replay=1ops 2017-06-14 01:21:19,206 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:21:20,165 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=16/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20000ms, replay=100ops 2017-06-14 01:21:20,166 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:21:20,610 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=26/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20027ms, replay=100ops 2017-06-14 01:21:20,612 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:21:22,769 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20092ms, replay=1ops 2017-06-14 01:21:22,776 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:21:36,382 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=15/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20190ms, replay=1ops 2017-06-14 01:21:36,387 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:21:38,111 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=31/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20017ms, replay=1ops 2017-06-14 01:21:38,119 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:21:39,293 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=27/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20066ms, replay=1ops 2017-06-14 01:21:39,302 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:21:40,167 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=17/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20141ms, replay=100ops 2017-06-14 01:21:40,167 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:21:40,638 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=27/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20190ms, replay=100ops 2017-06-14 01:21:40,648 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:21:42,862 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20068ms, replay=1ops 2017-06-14 01:21:42,864 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:21:56,574 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=16/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20132ms, replay=1ops 2017-06-14 01:21:56,575 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:21:58,129 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=32/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20056ms, replay=1ops 2017-06-14 01:21:58,130 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:21:59,360 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20142ms, replay=1ops 2017-06-14 01:21:59,363 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:22:00,309 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=18/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20048ms, replay=100ops 2017-06-14 01:22:00,316 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:22:00,830 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=28/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20080ms, replay=100ops 2017-06-14 01:22:00,832 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:22:02,932 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20167ms, replay=1ops 2017-06-14 01:22:02,939 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:22:16,707 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:22:16,707 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=17/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20072ms, replay=1ops 2017-06-14 01:22:18,187 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=33/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20061ms, replay=1ops 2017-06-14 01:22:18,191 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:22:19,504 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20188ms, replay=1ops 2017-06-14 01:22:19,513 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:22:20,359 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=19/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20011ms, replay=100ops 2017-06-14 01:22:20,362 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:22:20,911 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=29/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20116ms, replay=100ops 2017-06-14 01:22:20,918 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:22:23,101 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=26/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20044ms, replay=1ops 2017-06-14 01:22:23,101 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:22:36,780 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=18/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20075ms, replay=1ops 2017-06-14 01:22:36,790 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:22:38,249 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=34/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20045ms, replay=1ops 2017-06-14 01:22:38,254 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:22:39,693 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=30/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20156ms, replay=1ops 2017-06-14 01:22:39,697 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:22:40,372 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=20/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20140ms, replay=100ops 2017-06-14 01:22:40,375 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:22:41,028 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=30/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20165ms, replay=100ops 2017-06-14 01:22:41,032 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:22:43,146 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=27/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20016ms, replay=1ops 2017-06-14 01:22:43,149 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:22:50,772 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:22:56,857 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=19/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20183ms, replay=1ops 2017-06-14 01:22:56,862 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:22:58,295 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=35/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20192ms, replay=1ops 2017-06-14 01:22:58,297 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:22:59,851 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=31/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20081ms, replay=1ops 2017-06-14 01:22:59,853 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:23:00,513 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=21/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20188ms, replay=100ops 2017-06-14 01:23:00,518 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:23:00,812 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=10/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10000ms, replay=100ops 2017-06-14 01:23:00,819 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:23:01,195 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=31/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20135ms, replay=100ops 2017-06-14 01:23:01,202 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:23:03,164 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20050ms, replay=1ops 2017-06-14 01:23:03,170 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:23:10,814 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=11/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10091ms, replay=100ops 2017-06-14 01:23:10,823 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:23:17,041 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20095ms, replay=1ops 2017-06-14 01:23:17,050 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:23:18,488 INFO [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=36/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20125ms, replay=1ops 2017-06-14 01:23:18,492 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:23:19,934 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=32/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20154ms, replay=1ops 2017-06-14 01:23:19,939 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:23:20,703 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=22/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20038ms, replay=100ops 2017-06-14 01:23:20,708 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:23:20,907 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=12/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20174ms, replay=100ops 2017-06-14 01:23:20,910 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:23:21,331 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=32/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20155ms, replay=100ops 2017-06-14 01:23:21,336 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:23:23,215 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20133ms, replay=1ops 2017-06-14 01:23:23,222 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:23:37,138 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20185ms, replay=1ops 2017-06-14 01:23:37,147 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:23:38,614 WARN [hconnection-0x38d6795b-shared--pool21-t13039] client.AsyncProcess: #1012029217, table=SocialMediaInsights_New, attempt=37/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:14:27 GMT 2017; not retrying 1 - final failure 2017-06-14 01:23:38,614 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012029217, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:23:40,089 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=33/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20108ms, replay=1ops 2017-06-14 01:23:40,092 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:23:40,743 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=23/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20042ms, replay=100ops 2017-06-14 01:23:40,748 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:23:41,082 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=13/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20167ms, replay=100ops 2017-06-14 01:23:41,091 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:23:41,488 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=33/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20122ms, replay=100ops 2017-06-14 01:23:41,494 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:23:43,350 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=30/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20103ms, replay=1ops 2017-06-14 01:23:43,351 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:23:57,324 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20139ms, replay=1ops 2017-06-14 01:23:57,331 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:24:00,199 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:24:00,199 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=34/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20072ms, replay=1ops 2017-06-14 01:24:00,787 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=24/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20058ms, replay=100ops 2017-06-14 01:24:00,793 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:24:01,251 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=14/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20117ms, replay=100ops 2017-06-14 01:24:01,258 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:24:01,611 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=34/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20185ms, replay=100ops 2017-06-14 01:24:01,620 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:24:03,454 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=31/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20199ms, replay=1ops 2017-06-14 01:24:03,460 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:24:17,465 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=23/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20047ms, replay=1ops 2017-06-14 01:24:17,472 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:24:20,272 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=35/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20106ms, replay=1ops 2017-06-14 01:24:20,275 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:24:20,847 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=25/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20041ms, replay=100ops 2017-06-14 01:24:20,849 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:24:21,369 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=15/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20042ms, replay=100ops 2017-06-14 01:24:21,375 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:24:21,798 INFO [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=35/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20137ms, replay=100ops 2017-06-14 01:24:21,799 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:24:22,435 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:24:23,655 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=32/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20177ms, replay=1ops 2017-06-14 01:24:23,657 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:24:32,439 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=10/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10021ms, replay=1ops 2017-06-14 01:24:32,443 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:24:35,062 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:24:37,513 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20105ms, replay=1ops 2017-06-14 01:24:37,514 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:24:40,380 WARN [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012034915, table=SocialMediaInsights_New, attempt=36/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:15:49 GMT 2017; not retrying 1 - final failure 2017-06-14 01:24:40,380 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012034915, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:24:40,890 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=26/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20191ms, replay=100ops 2017-06-14 01:24:40,897 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:24:41,413 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=16/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20146ms, replay=100ops 2017-06-14 01:24:41,422 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:24:41,936 INFO [1491359256@qtp-2079565272-313725] client.AsyncProcess: #1012035018, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:24:41,937 WARN [hconnection-0x38d6795b-shared--pool21-t12887] client.AsyncProcess: #1012035018, table=ORMOverview, attempt=36/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:15:50 GMT 2017; not retrying 100 - final failure 2017-06-14 01:24:42,462 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=11/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10070ms, replay=1ops 2017-06-14 01:24:42,462 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:24:43,833 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=33/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20104ms, replay=1ops 2017-06-14 01:24:43,836 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:24:45,131 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=10/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10001ms, replay=1ops 2017-06-14 01:24:45,138 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:24:52,533 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=12/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20175ms, replay=1ops 2017-06-14 01:24:52,536 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:24:55,134 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=11/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10038ms, replay=1ops 2017-06-14 01:24:55,141 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:24:57,619 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20059ms, replay=1ops 2017-06-14 01:24:57,625 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:25:01,083 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=27/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20079ms, replay=100ops 2017-06-14 01:25:01,087 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:25:01,560 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=17/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20126ms, replay=100ops 2017-06-14 01:25:01,563 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:25:03,939 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=34/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20178ms, replay=1ops 2017-06-14 01:25:03,945 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:25:05,173 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=12/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20031ms, replay=1ops 2017-06-14 01:25:05,177 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:25:12,709 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=13/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20199ms, replay=1ops 2017-06-14 01:25:12,715 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:25:17,680 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=26/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20137ms, replay=1ops 2017-06-14 01:25:17,689 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:25:21,164 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=28/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20040ms, replay=100ops 2017-06-14 01:25:21,169 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:25:21,688 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=18/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20150ms, replay=100ops 2017-06-14 01:25:21,694 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:25:24,118 INFO [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=35/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20133ms, replay=1ops 2017-06-14 01:25:24,128 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:25:25,205 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=13/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20063ms, replay=1ops 2017-06-14 01:25:25,207 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:25:32,910 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=14/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20110ms, replay=1ops 2017-06-14 01:25:32,916 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:25:37,818 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=27/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20006ms, replay=1ops 2017-06-14 01:25:37,824 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:25:41,206 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=29/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20148ms, replay=100ops 2017-06-14 01:25:41,211 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:25:41,839 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=19/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20021ms, replay=100ops 2017-06-14 01:25:41,839 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:25:44,253 WARN [hconnection-0x38d6795b-shared--pool21-t12905] client.AsyncProcess: #1012040911, table=CampaignFactsByLinkClicksMDC, attempt=36/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:16:53 GMT 2017; not retrying 1 - final failure 2017-06-14 01:25:44,253 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012040911, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:25:45,269 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=14/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20033ms, replay=1ops 2017-06-14 01:25:45,273 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:25:53,021 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=15/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20173ms, replay=1ops 2017-06-14 01:25:53,029 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:25:57,826 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=28/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20009ms, replay=1ops 2017-06-14 01:25:57,828 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:26:01,356 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=30/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20000ms, replay=100ops 2017-06-14 01:26:01,359 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:26:01,862 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=20/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20168ms, replay=100ops 2017-06-14 01:26:01,866 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:26:05,303 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=15/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20089ms, replay=1ops 2017-06-14 01:26:05,311 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:26:10,756 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:26:13,195 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=16/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20058ms, replay=1ops 2017-06-14 01:26:13,195 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:26:17,836 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20048ms, replay=1ops 2017-06-14 01:26:17,844 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:26:20,775 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=10/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10039ms, replay=100ops 2017-06-14 01:26:20,783 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:26:21,358 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=31/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20001ms, replay=100ops 2017-06-14 01:26:21,359 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:26:22,031 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=21/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20146ms, replay=100ops 2017-06-14 01:26:22,032 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:26:25,394 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=16/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20089ms, replay=1ops 2017-06-14 01:26:25,398 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:26:30,815 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:26:30,816 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=11/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10061ms, replay=100ops 2017-06-14 01:26:33,254 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=17/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20055ms, replay=1ops 2017-06-14 01:26:33,258 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:26:37,885 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:26:37,885 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=30/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20045ms, replay=1ops 2017-06-14 01:26:40,878 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=12/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20003ms, replay=100ops 2017-06-14 01:26:40,880 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:26:41,361 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=32/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20030ms, replay=100ops 2017-06-14 01:26:41,364 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:26:42,179 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=22/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20046ms, replay=100ops 2017-06-14 01:26:42,184 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:26:45,484 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=17/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20192ms, replay=1ops 2017-06-14 01:26:45,490 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:26:50,072 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:26:53,311 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=18/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20176ms, replay=1ops 2017-06-14 01:26:53,319 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:26:57,932 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=31/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20181ms, replay=1ops 2017-06-14 01:26:57,937 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:27:00,123 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=10/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10086ms, replay=1ops 2017-06-14 01:27:00,128 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:27:00,883 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=13/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20117ms, replay=100ops 2017-06-14 01:27:00,892 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:27:01,393 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=33/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20029ms, replay=100ops 2017-06-14 01:27:01,399 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:27:02,227 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=23/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20189ms, replay=100ops 2017-06-14 01:27:02,228 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:27:05,678 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=18/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20146ms, replay=1ops 2017-06-14 01:27:05,685 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:27:10,210 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:27:10,211 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=11/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10000ms, replay=1ops 2017-06-14 01:27:13,488 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=19/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20103ms, replay=1ops 2017-06-14 01:27:13,491 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:27:18,114 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=32/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20018ms, replay=1ops 2017-06-14 01:27:18,120 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:27:20,212 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=12/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20190ms, replay=1ops 2017-06-14 01:27:20,219 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:27:21,001 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=14/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20199ms, replay=100ops 2017-06-14 01:27:21,009 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:27:21,423 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=34/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20086ms, replay=100ops 2017-06-14 01:27:21,431 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:27:22,418 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=24/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20152ms, replay=100ops 2017-06-14 01:27:22,421 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:27:25,826 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=19/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20049ms, replay=1ops 2017-06-14 01:27:25,827 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:27:33,593 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20167ms, replay=1ops 2017-06-14 01:27:33,596 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:27:38,134 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=33/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20123ms, replay=1ops 2017-06-14 01:27:38,143 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:27:40,404 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=13/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20172ms, replay=1ops 2017-06-14 01:27:40,406 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:27:41,202 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=15/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20068ms, replay=100ops 2017-06-14 01:27:41,210 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:27:41,511 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=35/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20181ms, replay=100ops 2017-06-14 01:27:41,519 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:27:42,572 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=25/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20018ms, replay=100ops 2017-06-14 01:27:42,578 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:27:45,876 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20042ms, replay=1ops 2017-06-14 01:27:45,883 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:27:53,761 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20115ms, replay=1ops 2017-06-14 01:27:53,770 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:27:58,258 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:27:58,258 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=34/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20054ms, replay=1ops 2017-06-14 01:28:00,577 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=14/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20030ms, replay=1ops 2017-06-14 01:28:00,578 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:28:01,272 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=16/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20123ms, replay=100ops 2017-06-14 01:28:01,273 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:28:01,694 INFO [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=36/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20158ms, replay=100ops 2017-06-14 01:28:01,703 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:28:02,592 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=26/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20186ms, replay=100ops 2017-06-14 01:28:02,594 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:28:05,919 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20031ms, replay=1ops 2017-06-14 01:28:05,924 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:28:13,878 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20096ms, replay=1ops 2017-06-14 01:28:13,883 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:28:18,314 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=35/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20117ms, replay=1ops 2017-06-14 01:28:18,323 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:28:20,608 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=15/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20084ms, replay=1ops 2017-06-14 01:28:20,615 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:28:21,396 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=17/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20041ms, replay=100ops 2017-06-14 01:28:21,402 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:28:21,854 WARN [hconnection-0x38d6795b-shared--pool21-t12750] client.AsyncProcess: #1012051803, table=ORMOverview, attempt=37/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:19:11 GMT 2017; not retrying 100 - final failure 2017-06-14 01:28:21,854 INFO [1048814188@qtp-2079565272-313731] client.AsyncProcess: #1012051803, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:28:22,780 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=27/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20130ms, replay=100ops 2017-06-14 01:28:22,783 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:28:25,952 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20025ms, replay=1ops 2017-06-14 01:28:25,954 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:28:33,975 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20177ms, replay=1ops 2017-06-14 01:28:33,980 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:28:38,433 INFO [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=36/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20172ms, replay=1ops 2017-06-14 01:28:38,439 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:28:40,694 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=16/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20191ms, replay=1ops 2017-06-14 01:28:40,698 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:28:41,439 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=18/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20082ms, replay=100ops 2017-06-14 01:28:41,444 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:28:42,912 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=28/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20043ms, replay=100ops 2017-06-14 01:28:42,918 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:28:45,979 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20153ms, replay=1ops 2017-06-14 01:28:45,984 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:28:54,154 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20192ms, replay=1ops 2017-06-14 01:28:54,162 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:28:58,606 WARN [hconnection-0x38d6795b-shared--pool21-t12917] client.AsyncProcess: #1012055334, table=CampaignFactsByLinkClicksMDC, attempt=37/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:19:47 GMT 2017; not retrying 1 - final failure 2017-06-14 01:28:58,606 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012055334, waiting for some tasks to finish. Expected max=0, tasksInProgress=6 2017-06-14 01:29:00,886 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=17/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20175ms, replay=1ops 2017-06-14 01:29:00,887 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:29:01,523 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=19/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20181ms, replay=100ops 2017-06-14 01:29:01,523 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:29:02,957 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=29/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20001ms, replay=100ops 2017-06-14 01:29:02,957 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:29:06,133 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20029ms, replay=1ops 2017-06-14 01:29:06,138 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:29:14,347 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=25/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20193ms, replay=1ops 2017-06-14 01:29:14,348 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:29:21,062 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=18/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20000ms, replay=1ops 2017-06-14 01:29:21,072 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:29:21,706 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=20/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20146ms, replay=100ops 2017-06-14 01:29:21,713 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:29:22,960 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=30/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20059ms, replay=100ops 2017-06-14 01:29:22,963 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:29:26,164 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20087ms, replay=1ops 2017-06-14 01:29:26,166 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:29:30,910 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:29:34,541 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=26/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20181ms, replay=1ops 2017-06-14 01:29:34,549 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:29:40,926 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=10/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10037ms, replay=100ops 2017-06-14 01:29:40,926 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:29:41,063 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=19/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20001ms, replay=1ops 2017-06-14 01:29:41,069 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:29:41,854 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=21/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20081ms, replay=100ops 2017-06-14 01:29:41,858 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:29:43,021 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=31/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20129ms, replay=100ops 2017-06-14 01:29:43,029 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:29:46,252 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=26/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20123ms, replay=1ops 2017-06-14 01:29:46,261 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:29:50,965 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=11/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10038ms, replay=100ops 2017-06-14 01:29:50,972 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:29:54,724 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:29:54,724 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=27/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20041ms, replay=1ops 2017-06-14 01:30:01,005 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=12/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20163ms, replay=100ops 2017-06-14 01:30:01,008 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:30:01,065 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=20/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20080ms, replay=1ops 2017-06-14 01:30:01,074 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:30:01,937 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=22/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20032ms, replay=100ops 2017-06-14 01:30:01,943 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:30:03,153 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=32/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20010ms, replay=100ops 2017-06-14 01:30:03,159 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:30:06,377 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=27/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20080ms, replay=1ops 2017-06-14 01:30:06,384 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:30:14,766 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20152ms, replay=1ops 2017-06-14 01:30:14,766 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:30:21,147 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20015ms, replay=1ops 2017-06-14 01:30:21,147 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:30:21,169 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=13/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20195ms, replay=100ops 2017-06-14 01:30:21,177 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:30:21,970 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=23/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20142ms, replay=100ops 2017-06-14 01:30:21,976 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:30:23,165 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=33/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20085ms, replay=100ops 2017-06-14 01:30:23,167 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:30:26,458 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20183ms, replay=1ops 2017-06-14 01:30:26,464 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:30:34,920 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20134ms, replay=1ops 2017-06-14 01:30:34,920 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:30:41,163 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20155ms, replay=1ops 2017-06-14 01:30:41,171 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:30:41,366 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=14/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20014ms, replay=100ops 2017-06-14 01:30:41,371 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:30:42,114 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=24/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20061ms, replay=100ops 2017-06-14 01:30:42,118 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:30:43,251 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:30:43,252 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=34/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20054ms, replay=100ops 2017-06-14 01:30:46,643 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20044ms, replay=1ops 2017-06-14 01:30:46,647 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:30:55,057 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=30/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20130ms, replay=1ops 2017-06-14 01:30:55,060 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:31:01,319 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=23/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20046ms, replay=1ops 2017-06-14 01:31:01,328 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:31:01,381 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=15/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20069ms, replay=100ops 2017-06-14 01:31:01,388 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:31:02,177 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=25/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20064ms, replay=100ops 2017-06-14 01:31:02,178 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:31:03,308 INFO [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=35/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20062ms, replay=100ops 2017-06-14 01:31:03,311 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:31:06,688 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=30/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20188ms, replay=1ops 2017-06-14 01:31:06,697 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:31:15,188 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=31/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20060ms, replay=1ops 2017-06-14 01:31:15,190 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:31:16,949 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:31:21,305 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:31:21,366 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=24/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20053ms, replay=1ops 2017-06-14 01:31:21,376 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:31:21,451 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=16/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20153ms, replay=100ops 2017-06-14 01:31:21,458 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:31:22,243 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=26/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20088ms, replay=100ops 2017-06-14 01:31:22,246 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:31:23,372 WARN [hconnection-0x38d6795b-shared--pool21-t12952] client.AsyncProcess: #1012066488, table=ORMOverview, attempt=36/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:22:32 GMT 2017; not retrying 100 - final failure 2017-06-14 01:31:23,372 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012066488, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:31:26,878 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=31/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20117ms, replay=1ops 2017-06-14 01:31:26,886 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:31:27,002 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=10/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10040ms, replay=1ops 2017-06-14 01:31:27,007 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:31:31,347 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=10/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10095ms, replay=1ops 2017-06-14 01:31:31,347 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:31:35,250 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=32/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20174ms, replay=1ops 2017-06-14 01:31:35,255 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:31:37,044 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=11/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10080ms, replay=1ops 2017-06-14 01:31:37,049 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:31:41,421 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20031ms, replay=1ops 2017-06-14 01:31:41,428 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:31:41,443 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=11/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10052ms, replay=1ops 2017-06-14 01:31:41,446 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:31:41,606 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=17/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20048ms, replay=100ops 2017-06-14 01:31:41,614 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:31:42,333 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=27/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20076ms, replay=100ops 2017-06-14 01:31:42,336 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:31:46,997 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=32/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20009ms, replay=1ops 2017-06-14 01:31:47,001 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:31:47,125 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=12/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20153ms, replay=1ops 2017-06-14 01:31:47,132 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:31:51,497 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=12/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20038ms, replay=1ops 2017-06-14 01:31:51,504 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:31:55,425 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=33/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20122ms, replay=1ops 2017-06-14 01:31:55,426 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:32:01,454 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=26/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20034ms, replay=1ops 2017-06-14 01:32:01,455 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:32:01,655 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=18/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20181ms, replay=100ops 2017-06-14 01:32:01,665 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:32:02,411 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=28/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20124ms, replay=100ops 2017-06-14 01:32:02,413 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:32:07,007 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:32:07,007 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=33/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20188ms, replay=1ops 2017-06-14 01:32:07,279 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=13/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20172ms, replay=1ops 2017-06-14 01:32:07,280 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:32:11,536 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=13/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20090ms, replay=1ops 2017-06-14 01:32:11,539 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:32:15,549 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:32:15,549 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=34/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20040ms, replay=1ops 2017-06-14 01:32:21,489 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=27/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20140ms, replay=1ops 2017-06-14 01:32:21,489 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:32:21,838 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=19/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20175ms, replay=100ops 2017-06-14 01:32:21,847 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:32:22,537 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=29/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20080ms, replay=100ops 2017-06-14 01:32:22,538 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:32:27,197 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=34/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20182ms, replay=1ops 2017-06-14 01:32:27,203 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:32:27,452 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=14/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20017ms, replay=1ops 2017-06-14 01:32:27,456 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:32:31,627 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=14/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20167ms, replay=1ops 2017-06-14 01:32:31,630 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:32:35,590 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=35/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20015ms, replay=1ops 2017-06-14 01:32:35,592 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:32:41,631 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20125ms, replay=1ops 2017-06-14 01:32:41,638 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:32:42,014 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=20/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20042ms, replay=100ops 2017-06-14 01:32:42,021 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:32:42,619 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=30/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20090ms, replay=100ops 2017-06-14 01:32:42,621 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:32:47,381 INFO [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=35/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20128ms, replay=1ops 2017-06-14 01:32:47,385 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:32:47,470 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=15/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20095ms, replay=1ops 2017-06-14 01:32:47,476 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:32:51,796 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=15/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20102ms, replay=1ops 2017-06-14 01:32:51,803 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:32:52,813 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:32:55,607 INFO [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=36/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20000ms, replay=1ops 2017-06-14 01:32:55,611 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:33:01,757 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20178ms, replay=1ops 2017-06-14 01:33:01,767 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:33:02,058 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=21/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20029ms, replay=100ops 2017-06-14 01:33:02,059 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:33:02,710 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=31/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20108ms, replay=100ops 2017-06-14 01:33:02,716 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:33:02,861 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=10/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10004ms, replay=100ops 2017-06-14 01:33:02,865 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:33:07,510 WARN [hconnection-0x38d6795b-shared--pool21-t12966] client.AsyncProcess: #1012074263, table=CampaignFactsByLinkClicksMDC, attempt=36/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:24:16 GMT 2017; not retrying 1 - final failure 2017-06-14 01:33:07,510 INFO [16720314@qtp-2079565272-313743] client.AsyncProcess: #1012074263, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:33:07,566 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=16/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20029ms, replay=1ops 2017-06-14 01:33:07,571 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:33:11,900 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=16/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20118ms, replay=1ops 2017-06-14 01:33:11,902 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:33:12,866 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=11/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10014ms, replay=100ops 2017-06-14 01:33:12,871 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:33:15,608 WARN [hconnection-0x38d6795b-shared--pool21-t12922] client.AsyncProcess: #1012073690, table=CampaignFactsByLinkClicksMDC, attempt=37/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:24:04 GMT 2017; not retrying 1 - final failure 2017-06-14 01:33:15,609 INFO [2121024227@qtp-2079565272-313756] client.AsyncProcess: #1012073690, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:33:21,937 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=30/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20003ms, replay=1ops 2017-06-14 01:33:21,940 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:33:22,088 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=22/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20014ms, replay=100ops 2017-06-14 01:33:22,091 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:33:22,820 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=32/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20096ms, replay=100ops 2017-06-14 01:33:22,827 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:33:22,881 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=12/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20023ms, replay=100ops 2017-06-14 01:33:22,888 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:33:27,596 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=17/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20182ms, replay=1ops 2017-06-14 01:33:27,605 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:33:32,019 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=17/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20031ms, replay=1ops 2017-06-14 01:33:32,019 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:33:41,942 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=31/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20126ms, replay=1ops 2017-06-14 01:33:41,948 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:33:42,104 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=23/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20175ms, replay=100ops 2017-06-14 01:33:42,106 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:33:42,906 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=13/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20136ms, replay=100ops 2017-06-14 01:33:42,908 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:33:42,918 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=33/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20119ms, replay=100ops 2017-06-14 01:33:42,922 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:33:47,780 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=18/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20037ms, replay=1ops 2017-06-14 01:33:47,784 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:33:52,052 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=18/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20157ms, replay=1ops 2017-06-14 01:33:52,054 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:34:02,069 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=32/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20010ms, replay=1ops 2017-06-14 01:34:02,071 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:34:02,280 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=24/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20132ms, replay=100ops 2017-06-14 01:34:02,283 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:34:03,039 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=34/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20072ms, replay=100ops 2017-06-14 01:34:03,043 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=14/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20195ms, replay=100ops 2017-06-14 01:34:03,044 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:34:03,046 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:34:07,103 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:34:07,818 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=19/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20086ms, replay=1ops 2017-06-14 01:34:07,820 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:34:12,210 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=19/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20146ms, replay=1ops 2017-06-14 01:34:12,219 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:34:17,154 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=10/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10013ms, replay=1ops 2017-06-14 01:34:17,154 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:34:22,081 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=33/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20159ms, replay=1ops 2017-06-14 01:34:22,084 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:34:22,414 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=25/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20081ms, replay=100ops 2017-06-14 01:34:22,417 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:34:23,113 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=35/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20077ms, replay=100ops 2017-06-14 01:34:23,113 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:34:23,239 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=15/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20097ms, replay=100ops 2017-06-14 01:34:23,245 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:34:27,168 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=11/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10030ms, replay=1ops 2017-06-14 01:34:27,171 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:34:27,905 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=20/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20013ms, replay=1ops 2017-06-14 01:34:27,909 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:34:32,358 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20104ms, replay=1ops 2017-06-14 01:34:32,364 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:34:37,200 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=12/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20139ms, replay=1ops 2017-06-14 01:34:37,207 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:34:42,241 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=34/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20144ms, replay=1ops 2017-06-14 01:34:42,249 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:34:42,496 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=26/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20066ms, replay=100ops 2017-06-14 01:34:42,501 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:34:43,191 INFO [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=36/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20071ms, replay=100ops 2017-06-14 01:34:43,194 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:34:43,338 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=16/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20070ms, replay=100ops 2017-06-14 01:34:43,340 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:34:47,919 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:34:47,919 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20164ms, replay=1ops 2017-06-14 01:34:52,463 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20031ms, replay=1ops 2017-06-14 01:34:52,467 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:34:57,340 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=13/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20156ms, replay=1ops 2017-06-14 01:34:57,343 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:35:02,387 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=35/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20074ms, replay=1ops 2017-06-14 01:35:02,389 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:35:02,564 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=27/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20149ms, replay=100ops 2017-06-14 01:35:02,567 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:35:03,264 WARN [hconnection-0x38d6795b-shared--pool21-t13078] client.AsyncProcess: #1012077319, table=ORMOverview, attempt=37/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:25:52 GMT 2017; not retrying 100 - final failure 2017-06-14 01:35:03,264 INFO [1250324451@qtp-2079565272-313748] client.AsyncProcess: #1012077319, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:35:03,410 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=17/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20029ms, replay=100ops 2017-06-14 01:35:03,416 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:35:08,085 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20090ms, replay=1ops 2017-06-14 01:35:08,091 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:35:12,496 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20166ms, replay=1ops 2017-06-14 01:35:12,499 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:35:17,498 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=14/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20135ms, replay=1ops 2017-06-14 01:35:17,505 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:35:22,462 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:35:22,462 INFO [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=36/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20117ms, replay=1ops 2017-06-14 01:35:22,714 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=28/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20192ms, replay=100ops 2017-06-14 01:35:22,723 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:35:23,440 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=18/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20181ms, replay=100ops 2017-06-14 01:35:23,441 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:35:28,176 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20030ms, replay=1ops 2017-06-14 01:35:28,182 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:35:32,664 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20167ms, replay=1ops 2017-06-14 01:35:32,673 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:35:37,635 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=15/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20184ms, replay=1ops 2017-06-14 01:35:37,635 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:35:42,581 WARN [hconnection-0x38d6795b-shared--pool21-t12997] client.AsyncProcess: #1012079572, table=CampaignFactsByLinkClicksMDC, attempt=37/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:26:31 GMT 2017; not retrying 1 - final failure 2017-06-14 01:35:42,581 INFO [1172311346@qtp-2079565272-313747] client.AsyncProcess: #1012079572, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:35:42,908 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=29/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20110ms, replay=100ops 2017-06-14 01:35:42,915 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:35:43,623 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=19/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20182ms, replay=100ops 2017-06-14 01:35:43,632 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:35:48,208 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20011ms, replay=1ops 2017-06-14 01:35:48,217 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:35:52,832 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20042ms, replay=1ops 2017-06-14 01:35:52,841 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:35:57,820 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=16/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20198ms, replay=1ops 2017-06-14 01:35:57,825 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:36:03,020 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=30/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20032ms, replay=100ops 2017-06-14 01:36:03,027 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:36:03,806 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=20/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20005ms, replay=100ops 2017-06-14 01:36:03,813 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:36:08,220 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20098ms, replay=1ops 2017-06-14 01:36:08,225 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:36:12,876 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=25/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20192ms, replay=1ops 2017-06-14 01:36:12,879 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:36:18,020 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=17/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20122ms, replay=1ops 2017-06-14 01:36:18,021 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:36:23,053 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=31/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20181ms, replay=100ops 2017-06-14 01:36:23,061 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:36:23,825 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:36:23,825 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=21/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20068ms, replay=100ops 2017-06-14 01:36:28,320 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=26/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20023ms, replay=1ops 2017-06-14 01:36:28,326 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:36:33,070 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=26/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20193ms, replay=1ops 2017-06-14 01:36:33,073 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:36:36,960 INFO [784008859@qtp-2079565272-313765] client.AsyncProcess: #1012107559, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:36:38,143 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=18/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20062ms, replay=1ops 2017-06-14 01:36:38,151 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=18 2017-06-14 01:36:43,236 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=32/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20039ms, replay=100ops 2017-06-14 01:36:43,241 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:36:43,895 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=22/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20098ms, replay=100ops 2017-06-14 01:36:43,899 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:36:47,016 INFO [hconnection-0x38d6795b-shared--pool21-t12987] client.AsyncProcess: #1012107559, table=ORMOverview, attempt=10/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10098ms, replay=100ops 2017-06-14 01:36:47,024 INFO [784008859@qtp-2079565272-313765] client.AsyncProcess: #1012107559, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:36:48,344 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=27/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20149ms, replay=1ops 2017-06-14 01:36:48,344 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:36:53,264 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=27/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20050ms, replay=1ops 2017-06-14 01:36:53,272 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:36:57,116 INFO [hconnection-0x38d6795b-shared--pool21-t12987] client.AsyncProcess: #1012107559, table=ORMOverview, attempt=11/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10005ms, replay=100ops 2017-06-14 01:36:57,121 INFO [784008859@qtp-2079565272-313765] client.AsyncProcess: #1012107559, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:36:58,206 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=19/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20082ms, replay=1ops 2017-06-14 01:36:58,208 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=19 2017-06-14 01:37:03,277 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=33/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20044ms, replay=100ops 2017-06-14 01:37:03,283 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=33 2017-06-14 01:37:03,994 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=23/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20187ms, replay=100ops 2017-06-14 01:37:04,002 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:37:07,123 INFO [hconnection-0x38d6795b-shared--pool21-t12987] client.AsyncProcess: #1012107559, table=ORMOverview, attempt=12/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20029ms, replay=100ops 2017-06-14 01:37:07,128 INFO [784008859@qtp-2079565272-313765] client.AsyncProcess: #1012107559, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:37:08,494 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=28/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20133ms, replay=1ops 2017-06-14 01:37:08,494 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:37:08,828 INFO [2111495988@qtp-2079565272-313768] client.AsyncProcess: #1012110450, waiting for some tasks to finish. Expected max=0, tasksInProgress=9 2017-06-14 01:37:13,315 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=28/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20098ms, replay=1ops 2017-06-14 01:37:13,316 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:37:18,289 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=20/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20078ms, replay=1ops 2017-06-14 01:37:18,290 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=20 2017-06-14 01:37:18,907 INFO [hconnection-0x38d6795b-shared--pool21-t12972] client.AsyncProcess: #1012110450, table=CampaignFactsByLinkClicksMDC, attempt=10/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10030ms, replay=1ops 2017-06-14 01:37:18,914 INFO [2111495988@qtp-2079565272-313768] client.AsyncProcess: #1012110450, waiting for some tasks to finish. Expected max=0, tasksInProgress=10 2017-06-14 01:37:23,323 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=34 2017-06-14 01:37:23,323 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=34/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20033ms, replay=100ops 2017-06-14 01:37:24,183 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=24/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20096ms, replay=100ops 2017-06-14 01:37:24,191 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:37:27,154 INFO [hconnection-0x38d6795b-shared--pool21-t12987] client.AsyncProcess: #1012107559, table=ORMOverview, attempt=13/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20165ms, replay=100ops 2017-06-14 01:37:27,158 INFO [784008859@qtp-2079565272-313765] client.AsyncProcess: #1012107559, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:37:28,628 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=29/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20072ms, replay=1ops 2017-06-14 01:37:28,634 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:37:28,938 INFO [hconnection-0x38d6795b-shared--pool21-t12972] client.AsyncProcess: #1012110450, table=CampaignFactsByLinkClicksMDC, attempt=11/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=10059ms, replay=1ops 2017-06-14 01:37:28,942 INFO [2111495988@qtp-2079565272-313768] client.AsyncProcess: #1012110450, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:37:33,415 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=29/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20092ms, replay=1ops 2017-06-14 01:37:33,421 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=29 2017-06-14 01:37:38,369 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=21/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20154ms, replay=1ops 2017-06-14 01:37:38,370 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=21 2017-06-14 01:37:38,998 INFO [hconnection-0x38d6795b-shared--pool21-t12972] client.AsyncProcess: #1012110450, table=CampaignFactsByLinkClicksMDC, attempt=12/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20153ms, replay=1ops 2017-06-14 01:37:39,000 INFO [2111495988@qtp-2079565272-313768] client.AsyncProcess: #1012110450, waiting for some tasks to finish. Expected max=0, tasksInProgress=12 2017-06-14 01:37:43,358 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=35/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20180ms, replay=100ops 2017-06-14 01:37:43,362 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=35 2017-06-14 01:37:44,281 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=25/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20133ms, replay=100ops 2017-06-14 01:37:44,290 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=25 2017-06-14 01:37:47,321 INFO [hconnection-0x38d6795b-shared--pool21-t12987] client.AsyncProcess: #1012107559, table=ORMOverview, attempt=14/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20095ms, replay=100ops 2017-06-14 01:37:47,323 INFO [784008859@qtp-2079565272-313765] client.AsyncProcess: #1012107559, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:37:48,702 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=30/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20105ms, replay=1ops 2017-06-14 01:37:48,707 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:37:53,508 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=30/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20139ms, replay=1ops 2017-06-14 01:37:53,513 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=30 2017-06-14 01:37:58,524 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=22/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20064ms, replay=1ops 2017-06-14 01:37:58,526 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=22 2017-06-14 01:37:59,152 INFO [hconnection-0x38d6795b-shared--pool21-t12972] client.AsyncProcess: #1012110450, table=CampaignFactsByLinkClicksMDC, attempt=13/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20032ms, replay=1ops 2017-06-14 01:37:59,162 INFO [2111495988@qtp-2079565272-313768] client.AsyncProcess: #1012110450, waiting for some tasks to finish. Expected max=0, tasksInProgress=13 2017-06-14 01:38:03,540 INFO [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=36/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20112ms, replay=100ops 2017-06-14 01:38:03,544 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=36 2017-06-14 01:38:04,415 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=26/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20155ms, replay=100ops 2017-06-14 01:38:04,420 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=26 2017-06-14 01:38:07,418 INFO [hconnection-0x38d6795b-shared--pool21-t12987] client.AsyncProcess: #1012107559, table=ORMOverview, attempt=15/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20122ms, replay=100ops 2017-06-14 01:38:07,419 INFO [784008859@qtp-2079565272-313765] client.AsyncProcess: #1012107559, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:38:08,808 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=31/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20064ms, replay=1ops 2017-06-14 01:38:08,811 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:38:13,649 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=31/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20056ms, replay=1ops 2017-06-14 01:38:13,653 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=31 2017-06-14 01:38:18,590 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=23/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20185ms, replay=1ops 2017-06-14 01:38:18,593 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=23 2017-06-14 01:38:19,186 INFO [hconnection-0x38d6795b-shared--pool21-t12972] client.AsyncProcess: #1012110450, table=CampaignFactsByLinkClicksMDC, attempt=14/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20177ms, replay=1ops 2017-06-14 01:38:19,193 INFO [2111495988@qtp-2079565272-313768] client.AsyncProcess: #1012110450, waiting for some tasks to finish. Expected max=0, tasksInProgress=14 2017-06-14 01:38:23,655 WARN [hconnection-0x38d6795b-shared--pool21-t12970] client.AsyncProcess: #1012085605, table=ORMOverview, attempt=37/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started Wed Jun 14 01:29:12 GMT 2017; not retrying 100 - final failure 2017-06-14 01:38:23,655 INFO [593153425@qtp-2079565272-313750] client.AsyncProcess: #1012085605, waiting for some tasks to finish. Expected max=0, tasksInProgress=11 2017-06-14 01:38:24,572 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=27/35 failed=100ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20025ms, replay=100ops 2017-06-14 01:38:24,578 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=27 2017-06-14 01:38:27,542 INFO [hconnection-0x38d6795b-shared--pool21-t12987] client.AsyncProcess: #1012107559, table=ORMOverview, attempt=16/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20140ms, replay=100ops 2017-06-14 01:38:27,546 INFO [784008859@qtp-2079565272-313765] client.AsyncProcess: #1012107559, waiting for some tasks to finish. Expected max=0, tasksInProgress=16 2017-06-14 01:38:28,873 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=32/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20104ms, replay=1ops 2017-06-14 01:38:28,880 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:38:33,707 INFO [hconnection-0x38d6795b-shared--pool21-t12993] client.AsyncProcess: #1012091895, table=SocialMediaInsights_New, attempt=32/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20157ms, replay=1ops 2017-06-14 01:38:33,711 INFO [666508556@qtp-2079565272-313763] client.AsyncProcess: #1012091895, waiting for some tasks to finish. Expected max=0, tasksInProgress=32 2017-06-14 01:38:38,776 INFO [hconnection-0x38d6795b-shared--pool21-t12929] client.AsyncProcess: #1012098308, table=CampaignFactsByLinkClicksMDC, attempt=24/35 failed=1ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20026ms, replay=1ops 2017-06-14 01:38:38,783 INFO [409414038@qtp-2079565272-313760] client.AsyncProcess: #1012098308, waiting for some tasks to finish. Expected max=0, tasksInProgress=24 2017-06-14 01:38:39,363 INFO [hconnection-0x38d6795b-shared--pool21-t12972] client.AsyncProcess: #1012110450, table=CampaignFactsByLinkClicksMDC, attempt=15/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20032ms, replay=1ops 2017-06-14 01:38:39,368 INFO [2111495988@qtp-2079565272-313768] client.AsyncProcess: #1012110450, waiting for some tasks to finish. Expected max=0, tasksInProgress=15 2017-06-14 01:38:44,599 INFO [57456530@qtp-2079565272-313753] client.AsyncProcess: #1012095275, waiting for some tasks to finish. Expected max=0, tasksInProgress=28 2017-06-14 01:38:44,599 INFO [hconnection-0x38d6795b-shared--pool21-t12880] client.AsyncProcess: #1012095275, table=ORMDetails, attempt=28/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20079ms, replay=100ops 2017-06-14 01:38:47,684 INFO [hconnection-0x38d6795b-shared--pool21-t12987] client.AsyncProcess: #1012107559, table=ORMOverview, attempt=17/35 failed=100ops, last exception: java.net.ConnectException: Connection refused on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20014ms, replay=100ops 2017-06-14 01:38:47,685 INFO [784008859@qtp-2079565272-313765] client.AsyncProcess: #1012107559, waiting for some tasks to finish. Expected max=0, tasksInProgress=17 2017-06-14 01:38:48,978 INFO [hconnection-0x38d6795b-shared--pool21-t12989] client.AsyncProcess: #1012091698, table=SocialMediaInsights_New, attempt=33/35 failed=1ops, last exception: org.apache.hadoop.hbase.ipc.FailedServerException: This server is in the failed servers list: aps-hadoop4/hadoop4:16020 on aps-hadoop4,16020,1497285023004, tracking started null, retrying after=20189ms, replay=1ops 2017-06-14 01:38:48,980 INFO [1065845585@qtp-2079565272-313759] client.AsyncProcess: #1012091698, waiting for some tasks to finish. Expected max=0, tasksInProgress=33