Member since
07-01-2015
460
Posts
78
Kudos Received
43
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1753 | 11-26-2019 11:47 PM | |
| 1634 | 11-25-2019 11:44 AM | |
| 10736 | 08-07-2019 12:48 AM | |
| 2640 | 04-17-2019 03:09 AM | |
| 4349 | 02-18-2019 12:23 AM |
09-20-2018
11:41 AM
Hi, it is not so common to have a date in this format, but it is possible to convert it into timestamp in Impala. Your approach was good, just used a wrong format: > CORRECT FORMAT
[10.197.0.1:21000] > select *, cast( unix_timestamp(s, "M/d/yyyy") as timestamp ) from work.t;
+-----+------------+--------------------------------------------------+
| id | s | cast(unix_timestamp(s, 'm/d/yyyy') as timestamp) |
+-----+------------+--------------------------------------------------+
| 100 | 12/24/2018 | 2018-12-24 00:00:00 |
| 200 | 3/24/2018 | 2018-03-24 00:00:00 |
+-----+------------+--------------------------------------------------+
Fetched 2 row(s) in 0.33s
> THIS IS A WRONG FORMAT
[10.197.0.1:21000] > select *, cast( unix_timestamp(s, "MM/dd/yyyy") as timestamp ) from work.t;
+-----+------------+----------------------------------------------------+
| id | s | cast(unix_timestamp(s, 'mm/dd/yyyy') as timestamp) |
+-----+------------+----------------------------------------------------+
| 100 | 12/24/2018 | 2018-12-24 00:00:00 |
| 200 | 3/24/2018 | NULL |
+-----+------------+----------------------------------------------------+ Convert the string to a date and then you can use a correct where conditions.
... View more
09-18-2018
11:59 AM
I will check it. CDH 5.13 Do I understand your explanation correctly that this is a problem that the agent does not "see" the hue service alivve? But then it would just report a false alarm, but actually the hue server was not available, I did not investigated the processes but I am quite sure that the Hue process was not running
... View more
09-18-2018
06:27 AM
Today I catched another Hue failure. Here is the content of runcpserver.log: [18/Sep/2018 15:04:52 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:04:52 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:04:52 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:04:52 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:04 +0200] access INFO 212.45.173.105, 10.197.144.123 eyl7443 - "POST /jobbrowser/jobs/ HTTP/1.1"
[18/Sep/2018 15:05:04 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:04 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:04 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:04 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:17 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/jobs/ HTTP/1.1"
[18/Sep/2018 15:05:17 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:17 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:17 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:17 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:18 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:05:18 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:18 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:18 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:18 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:19 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:05:19 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:19 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:19 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:19 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:43 +0200] access INFO 212.45.173.105, 10.197.144.123 eyl7443 - "POST /jobbrowser/jobs/ HTTP/1.1"
[18/Sep/2018 15:05:43 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:43 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:43 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:43 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:51 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:05:51 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:51 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:05:51 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:05:51 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:05:51 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:04 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/jobs/ HTTP/1.1"
[18/Sep/2018 15:06:04 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:04 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:04 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:04 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:17 +0200] decorators INFO AXES: Calling decorated function: dt_login
[18/Sep/2018 15:06:20 +0200] access INFO 212.45.173.105, 10.197.144.123 eyl7443 - "POST /jobbrowser/jobs/ HTTP/1.1"
[18/Sep/2018 15:06:20 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:20 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:20 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:20 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:21 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:06:21 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:21 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:21 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:21 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:21 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:06:21 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:21 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:21 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:21 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:45 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:06:45 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:45 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:45 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:45 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:46 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:06:46 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:46 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:46 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:46 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:47 +0200] decorators INFO AXES: Calling decorated function: dt_login
[18/Sep/2018 15:06:54 +0200] access INFO 212.45.173.105, 10.197.144.123 eyl7443 - "POST /jobbrowser/jobs/ HTTP/1.1"
[18/Sep/2018 15:06:54 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:54 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:54 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:54 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:56 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/jobs/ HTTP/1.1"
[18/Sep/2018 15:06:56 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:56 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:06:56 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:06:56 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:07:04 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:07:04 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:07:04 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:07:04 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:07:04 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:07:04 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:07:04 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:07:04 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:07:04 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:07:04 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:07:04 +0200] access INFO 212.45.173.105, 10.197.132.245 nfc1092 - "POST /notebook/api/check_status HTTP/1.1"
[18/Sep/2018 15:07:05 +0200] access INFO 212.45.173.105, 10.197.132.245 nfc1092 - "POST /notebook/api/check_status HTTP/1.1"
[18/Sep/2018 15:07:06 +0200] access INFO 212.45.173.105, 10.197.132.245 nfc1092 - "POST /notebook/api/check_status HTTP/1.1"
[18/Sep/2018 15:07:22 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:07:22 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:07:22 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:07:22 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:07:22 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:07:22 +0200] access INFO 212.45.173.106, 10.197.144.123 wth8400 - "POST /jobbrowser/api/jobs HTTP/1.1"
[18/Sep/2018 15:07:22 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:07:22 +0200] cluster WARNING Picking RM HA: ha
[18/Sep/2018 15:07:23 +0200] cluster INFO RM default is not RUNNING, skipping it: {u'clusterInfo': {u'hadoopVersionBuiltOn': u'2018-03-17T11:29Z', u'startedOn': 1535656203104, u'haState': u'STANDBY', u'haZooKeeperConnectionState': u'CONNECTED', u'resourceManagerBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum c135844b5395ad0c0cdfd8ee671cccb', u'resourceManagerVersion': u'2.6.0-cdh5.13.3', u'state': u'STARTED', u'hadoopVersion': u'2.6.0-cdh5.13.3', u'resourceManagerVersionBuiltOn': u'2018-03-17T11:38Z', u'rmStateStoreName': u'org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore', u'hadoopBuildVersion': u'2.6.0-cdh5.13.3 from ad398b626d788a1fa5efbe790f38255540f31358 by jenkins source checksum 49734dccd1350506f3b98dff08f1438', u'id': 1535656203104}}
[18/Sep/2018 15:07:23 +0200] cluster WARNING Picking RM HA: ha
No error.. The last log is from 15:07
... View more
09-18-2018
05:53 AM
1 Kudo
If you want to create a backup cluster, just for backup purposes, you can skip the Sentry. Number of nodes would be min 3. You can use the same KDC for the backup cluster (if those two cluster are on the same network - i.e. there is no overlap on the hostnames and IP addresses), but make sure you follow the configurations for distcp between kerberized environments. You dont need the edge node as well.
... View more
09-17-2018
07:50 AM
The first explanation could be that the script is called without argument maybe?
... View more
09-17-2018
07:39 AM
I was replying to the idea of symlink. If you just want to access data from Cluster1 on Cluster2 (or anywhere else), make sure your hdfs config files for the client points to the Cluster1. I think it is hdfs-site.xml
... View more
09-17-2018
05:35 AM
I just noticed that for Hue you are running without TLS. This is nothing what will be "fixed" as it is based on your choice, if you run your cluster in secure/unsecure mode. Also I noticed that the NN is listening on 50070, so you are not running a Kerberized cluster, are you?
... View more
09-17-2018
05:27 AM
No that is not possible at all. If we are talking about the listing of directories, you have to understand what happens in the background: the namenode is reading (from memory) the list of the content. The "other" HDFS has its own namenode, so your namenode would have to contact the other's. Data retrieval: your hdfs client connects to the namenode and asks for the block location(s) of the file your are trying to access. Then it connects to the data nodes with the block request. There is just one namenode in this scenario. But what is possible to create a HDFS federation: there you can split the whole file directory tree and assign to multiple namenodes. But this is still a 1 cluster scenario.
... View more
09-12-2018
06:17 AM
1 Kudo
For example for 4GB map and reduce memory set this via Hive set mapreduce.map.memory.mb = 4096 set mapreduce.reduce.memory.mb = 4096
... View more