Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Job Submission failed with exception 'java.io.FileNotFoundException(File does not exist: hdfs://

Job Submission failed with exception 'java.io.FileNotFoundException(File does not exist: hdfs://

I am using the following version of Cloudera Express:

Cloudera Express 5.0.2 (#297 built by jenkins on 20140606-2222 git: 80907df78ba6b50c21a598f0caff8b00685d5961)

with the CDH 5.1.2-1.cdh5.1.2.p0.3 parcel activated.


I am trying to run the Intel Big-Bench benchmark: https://github.com/intel-hadoop/Big-Bench Execution of the benchmark failes somewhere at the step where hive loads data into its metastore.  In my log files, I find the following error:

 

Execution log at: /tmp/bart/bart_20140910120101_8cb323b0-3e10-477b-ad06-5e3dc9ed308f.log
java.io.FileNotFoundException: File does not exist: hdfs://sandy-quad-1.sslab.lan:8020/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hive/lib/hive-hbase-handler-0.12.0-cdh5.1.2.jar
        at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128)
        at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1120)
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1120)
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:288)
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:224)
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:93)
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(ClientDistributedCacheManager.java:57)
        at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:265)
        at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:301)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:389)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1295)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1292)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1292)
        at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:564)
        at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:559)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554)
        at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:559)
        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:550)
        at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:425)
        at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:733)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Job Submission failed with exception 'java.io.FileNotFoundException(File does not exist: hdfs://sandy-quad-1.sslab.lan:8020/opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hive/lib/hive-hbase-handler-0.12.0-cdh5.1.2.jar)'

 It seems like the hive-hbase-handler-0.12.0-cdh5.1.2.jar is searched for in HDFS, but this should probably not happen, because it is on the local filesystem:

 

bart@sandy-quad-1:~$ ls -al /opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hive/lib/hive-hbase-handler-0.12.0-cdh5.1.2.jar
-rw-r--r-- 1 root root 65987 Aug 26 04:58 /opt/cloudera/parcels/CDH-5.1.2-1.cdh5.1.2.p0.3/lib/hive/lib/hive-hbase-handler-0.12.0-cdh5.1.2.jar

 

I've found forum posts of similar problems with CDH 5.0.0 and 5.0.2:

but I don't see a real solution yet.

 

Does anybody know the solution to this problem?  How do I make sure hive-hbase-handler-0.12.0-cdh5.1.2.jar is not searched for in HDFS but on the local filesystem?

1 REPLY 1
Highlighted

Re: Job Submission failed with exception 'java.io.FileNotFoundException(File does not exist: hdfs://

I'm not sure if this info helps in debugging the problem, but here's what I see if I surf to http://sandy-quad-1:7180/api/v6/cm/deployment

 

{
  "timestamp" : "2014-09-11T09:42:50.782Z",
  "clusters" : [ {
    "name" : "cluster",
    "displayName" : "Cluster 1",
    "version" : "CDH5",
    "fullVersion" : "5.1.2",
    "services" : [ {
      "name" : "zookeeper",
      "type" : "ZOOKEEPER",
      "config" : {
        "items" : [ ]
      },
      "roles" : [ {
        "name" : "zookeeper-SERVER-336eb98913b4a2f17c66196f6b26555f",
        "type" : "SERVER",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ {
            "name" : "serverId",
            "value" : "1"
          } ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "zookeeper-SERVER-BASE"
        }
      }, {
        "name" : "zookeeper-SERVER-c2583642412c007c378b8fbd8b29771c",
        "type" : "SERVER",
        "hostRef" : {
          "hostId" : "ac771927-ccd9-410a-898a-84ba2e28fb20"
        },
        "config" : {
          "items" : [ {
            "name" : "serverId",
            "value" : "2"
          } ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "zookeeper-SERVER-BASE"
        }
      }, {
        "name" : "zookeeper-SERVER-c494e5482a7b2d8bfb6d99387525655f",
        "type" : "SERVER",
        "hostRef" : {
          "hostId" : "29459302-a438-4e8f-a49f-37ddead0911c"
        },
        "config" : {
          "items" : [ {
            "name" : "serverId",
            "value" : "3"
          } ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "zookeeper-SERVER-BASE"
        }
      } ],
      "displayName" : "ZooKeeper",
      "roleConfigGroups" : [ {
        "name" : "zookeeper-SERVER-BASE",
        "displayName" : "Server Default Group",
        "roleType" : "SERVER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "zookeeper"
        },
        "config" : {
          "items" : [ {
            "name" : "maxSessionTimeout",
            "value" : "60000"
          } ]
        }
      } ]
    }, {
      "name" : "oozie",
      "type" : "OOZIE",
      "config" : {
        "items" : [ {
          "name" : "mapreduce_yarn_service",
          "value" : "mapreduce"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "oozie-OOZIE_SERVER-336eb98913b4a2f17c66196f6b26555f",
        "type" : "OOZIE_SERVER",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "oozie-OOZIE_SERVER-BASE"
        }
      } ],
      "displayName" : "Oozie",
      "roleConfigGroups" : [ {
        "name" : "oozie-OOZIE_SERVER-BASE",
        "displayName" : "Oozie Server Default Group",
        "roleType" : "OOZIE_SERVER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "oozie"
        },
        "config" : {
          "items" : [ ]
        }
      } ]
    }, {
      "name" : "hdfs",
      "type" : "HDFS",
      "config" : {
        "items" : [ {
          "name" : "dfs_block_local_path_access_user",
          "value" : "impala"
        }, {
          "name" : "dfs_ha_fencing_cloudera_manager_secret_key",
          "value" : "mlRJqk9OA4aGAk3CqAZo3SSX0tZrPv"
        }, {
          "name" : "fc_authorization_secret_key",
          "value" : "PenPGvKHhM0OpRFFVPp0TC9Sxu1CQp"
        }, {
          "name" : "http_auth_signature_secret",
          "value" : "sLMD3f2yh83U6ogYSmX4yyeKkw9B7s"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "hdfs-DATANODE-224ee02c1848c168eeccd0ec91045a11",
        "type" : "DATANODE",
        "hostRef" : {
          "hostId" : "a5362b28-91ba-4d24-9afc-17b999808208"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hdfs-DATANODE-BASE"
        }
      }, {
        "name" : "hdfs-DATANODE-c2583642412c007c378b8fbd8b29771c",
        "type" : "DATANODE",
        "hostRef" : {
          "hostId" : "ac771927-ccd9-410a-898a-84ba2e28fb20"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hdfs-DATANODE-BASE"
        }
      }, {
        "name" : "hdfs-DATANODE-c494e5482a7b2d8bfb6d99387525655f",
        "type" : "DATANODE",
        "hostRef" : {
          "hostId" : "29459302-a438-4e8f-a49f-37ddead0911c"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hdfs-DATANODE-BASE"
        }
      }, {
        "name" : "hdfs-NAMENODE-336eb98913b4a2f17c66196f6b26555f",
        "type" : "NAMENODE",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hdfs-NAMENODE-BASE"
        }
      }, {
        "name" : "hdfs-SECONDARYNAMENODE-336eb98913b4a2f17c66196f6b26555f",
        "type" : "SECONDARYNAMENODE",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hdfs-SECONDARYNAMENODE-BASE"
        }
      } ],
      "displayName" : "HDFS",
      "roleConfigGroups" : [ {
        "name" : "hdfs-BALANCER-BASE",
        "displayName" : "Balancer Default Group",
        "roleType" : "BALANCER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hdfs"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hdfs-DATANODE-BASE",
        "displayName" : "DataNode Default Group",
        "roleType" : "DATANODE",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hdfs"
        },
        "config" : {
          "items" : [ {
            "name" : "dfs_data_dir_list",
            "value" : "/dfs/dn"
          }, {
            "name" : "dfs_datanode_data_dir_perm",
            "value" : "755"
          } ]
        }
      }, {
        "name" : "hdfs-FAILOVERCONTROLLER-BASE",
        "displayName" : "Failover Controller Default Group",
        "roleType" : "FAILOVERCONTROLLER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hdfs"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hdfs-GATEWAY-BASE",
        "displayName" : "Gateway Default Group",
        "roleType" : "GATEWAY",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hdfs"
        },
        "config" : {
          "items" : [ {
            "name" : "dfs_client_use_trash",
            "value" : "true"
          } ]
        }
      }, {
        "name" : "hdfs-HTTPFS-BASE",
        "displayName" : "HttpFS Default Group",
        "roleType" : "HTTPFS",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hdfs"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hdfs-JOURNALNODE-BASE",
        "displayName" : "JournalNode Default Group",
        "roleType" : "JOURNALNODE",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hdfs"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hdfs-NAMENODE-BASE",
        "displayName" : "NameNode Default Group",
        "roleType" : "NAMENODE",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hdfs"
        },
        "config" : {
          "items" : [ {
            "name" : "dfs_name_dir_list",
            "value" : "/dfs/nn"
          }, {
            "name" : "dfs_namenode_servicerpc_address",
            "value" : "8022"
          } ]
        }
      }, {
        "name" : "hdfs-NFSGATEWAY-BASE",
        "displayName" : "NFS Gateway Default Group",
        "roleType" : "NFSGATEWAY",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hdfs"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hdfs-SECONDARYNAMENODE-BASE",
        "displayName" : "SecondaryNameNode Default Group",
        "roleType" : "SECONDARYNAMENODE",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hdfs"
        },
        "config" : {
          "items" : [ {
            "name" : "fs_checkpoint_dir_list",
            "value" : "/dfs/snn"
          } ]
        }
      } ],
      "replicationSchedules" : [ ],
      "snapshotPolicies" : [ ]
    }, {
      "name" : "hbase",
      "type" : "HBASE",
      "config" : {
        "items" : [ {
          "name" : "hdfs_service",
          "value" : "hdfs"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "hbase-HBASETHRIFTSERVER-336eb98913b4a2f17c66196f6b26555f",
        "type" : "HBASETHRIFTSERVER",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hbase-HBASETHRIFTSERVER-BASE"
        }
      }, {
        "name" : "hbase-MASTER-336eb98913b4a2f17c66196f6b26555f",
        "type" : "MASTER",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hbase-MASTER-BASE"
        }
      }, {
        "name" : "hbase-REGIONSERVER-224ee02c1848c168eeccd0ec91045a11",
        "type" : "REGIONSERVER",
        "hostRef" : {
          "hostId" : "a5362b28-91ba-4d24-9afc-17b999808208"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hbase-REGIONSERVER-BASE"
        }
      }, {
        "name" : "hbase-REGIONSERVER-c2583642412c007c378b8fbd8b29771c",
        "type" : "REGIONSERVER",
        "hostRef" : {
          "hostId" : "ac771927-ccd9-410a-898a-84ba2e28fb20"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hbase-REGIONSERVER-BASE"
        }
      }, {
        "name" : "hbase-REGIONSERVER-c494e5482a7b2d8bfb6d99387525655f",
        "type" : "REGIONSERVER",
        "hostRef" : {
          "hostId" : "29459302-a438-4e8f-a49f-37ddead0911c"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hbase-REGIONSERVER-BASE"
        }
      } ],
      "displayName" : "HBase",
      "roleConfigGroups" : [ {
        "name" : "hbase-GATEWAY-BASE",
        "displayName" : "Gateway Default Group",
        "roleType" : "GATEWAY",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hbase"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hbase-HBASERESTSERVER-BASE",
        "displayName" : "HBase REST Server Default Group",
        "roleType" : "HBASERESTSERVER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hbase"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hbase-HBASETHRIFTSERVER-BASE",
        "displayName" : "HBase Thrift Server Default Group",
        "roleType" : "HBASETHRIFTSERVER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hbase"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hbase-MASTER-BASE",
        "displayName" : "Master Default Group",
        "roleType" : "MASTER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hbase"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hbase-REGIONSERVER-BASE",
        "displayName" : "RegionServer Default Group",
        "roleType" : "REGIONSERVER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hbase"
        },
        "config" : {
          "items" : [ ]
        }
      } ],
      "snapshotPolicies" : [ ]
    }, {
      "name" : "mapreduce",
      "type" : "MAPREDUCE",
      "config" : {
        "items" : [ {
          "name" : "hdfs_service",
          "value" : "hdfs"
        }, {
          "name" : "rm_dirty",
          "value" : "true"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "mapreduce-JOBTRACKER-336eb98913b4a2f17c66196f6b26555f",
        "type" : "JOBTRACKER",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "mapreduce-JOBTRACKER-BASE"
        }
      }, {
        "name" : "mapreduce-TASKTRACKER-224ee02c1848c168eeccd0ec91045a11",
        "type" : "TASKTRACKER",
        "hostRef" : {
          "hostId" : "a5362b28-91ba-4d24-9afc-17b999808208"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "mapreduce-TASKTRACKER-BASE"
        }
      }, {
        "name" : "mapreduce-TASKTRACKER-c2583642412c007c378b8fbd8b29771c",
        "type" : "TASKTRACKER",
        "hostRef" : {
          "hostId" : "ac771927-ccd9-410a-898a-84ba2e28fb20"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "mapreduce-TASKTRACKER-1"
        }
      }, {
        "name" : "mapreduce-TASKTRACKER-c494e5482a7b2d8bfb6d99387525655f",
        "type" : "TASKTRACKER",
        "hostRef" : {
          "hostId" : "29459302-a438-4e8f-a49f-37ddead0911c"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "mapreduce-TASKTRACKER-BASE"
        }
      } ],
      "displayName" : "MapReduce",
      "roleConfigGroups" : [ {
        "name" : "mapreduce-FAILOVERCONTROLLER-BASE",
        "displayName" : "Failover Controller Default Group",
        "roleType" : "FAILOVERCONTROLLER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "mapreduce"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "mapreduce-GATEWAY-BASE",
        "displayName" : "Gateway Default Group",
        "roleType" : "GATEWAY",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "mapreduce"
        },
        "config" : {
          "items" : [ {
            "name" : "mapred_reduce_tasks",
            "value" : "2"
          }, {
            "name" : "mapred_submit_replication",
            "value" : "1"
          } ]
        }
      }, {
        "name" : "mapreduce-JOBTRACKER-BASE",
        "displayName" : "JobTracker Default Group",
        "roleType" : "JOBTRACKER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "mapreduce"
        },
        "config" : {
          "items" : [ {
            "name" : "jobtracker_mapred_local_dir_list",
            "value" : "/mapred/jt"
          }, {
            "name" : "mapred_job_tracker_handler_count",
            "value" : "22"
          } ]
        }
      }, {
        "name" : "mapreduce-TASKTRACKER-1",
        "displayName" : "TaskTracker Group 1",
        "roleType" : "TASKTRACKER",
        "base" : false,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "mapreduce"
        },
        "config" : {
          "items" : [ {
            "name" : "mapred_tasktracker_instrumentation",
            "value" : "org.apache.hadoop.mapred.TaskTrackerCmonInst"
          }, {
            "name" : "mapred_tasktracker_map_tasks_maximum",
            "value" : "5"
          }, {
            "name" : "mapred_tasktracker_reduce_tasks_maximum",
            "value" : "3"
          }, {
            "name" : "task_tracker_java_heapsize",
            "value" : "201326592"
          }, {
            "name" : "tasktracker_mapred_local_dir_list",
            "value" : "/mapred/local"
          } ]
        }
      }, {
        "name" : "mapreduce-TASKTRACKER-BASE",
        "displayName" : "TaskTracker Default Group",
        "roleType" : "TASKTRACKER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "mapreduce"
        },
        "config" : {
          "items" : [ {
            "name" : "mapred_tasktracker_instrumentation",
            "value" : "org.apache.hadoop.mapred.TaskTrackerCmonInst"
          }, {
            "name" : "mapred_tasktracker_reduce_tasks_maximum",
            "value" : "1"
          }, {
            "name" : "task_tracker_java_heapsize",
            "value" : "96468992"
          }, {
            "name" : "tasktracker_mapred_local_dir_list",
            "value" : "/mapred/local"
          } ]
        }
      } ]
    }, {
      "name" : "hive",
      "type" : "HIVE",
      "config" : {
        "items" : [ {
          "name" : "hive_metastore_database_password",
          "value" : "hive"
        }, {
          "name" : "mapreduce_yarn_service",
          "value" : "mapreduce"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "hive-GATEWAY-224ee02c1848c168eeccd0ec91045a11",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "a5362b28-91ba-4d24-9afc-17b999808208"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hive-GATEWAY-BASE"
        }
      }, {
        "name" : "hive-GATEWAY-336eb98913b4a2f17c66196f6b26555f",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hive-GATEWAY-BASE"
        }
      }, {
        "name" : "hive-GATEWAY-c2583642412c007c378b8fbd8b29771c",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "ac771927-ccd9-410a-898a-84ba2e28fb20"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hive-GATEWAY-BASE"
        }
      }, {
        "name" : "hive-GATEWAY-c494e5482a7b2d8bfb6d99387525655f",
        "type" : "GATEWAY",
        "hostRef" : {
          "hostId" : "29459302-a438-4e8f-a49f-37ddead0911c"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hive-GATEWAY-BASE"
        }
      }, {
        "name" : "hive-HIVEMETASTORE-336eb98913b4a2f17c66196f6b26555f",
        "type" : "HIVEMETASTORE",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hive-HIVEMETASTORE-BASE"
        }
      }, {
        "name" : "hive-HIVESERVER2-336eb98913b4a2f17c66196f6b26555f",
        "type" : "HIVESERVER2",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hive-HIVESERVER2-BASE"
        }
      } ],
      "displayName" : "Hive",
      "roleConfigGroups" : [ {
        "name" : "hive-GATEWAY-BASE",
        "displayName" : "Gateway Default Group",
        "roleType" : "GATEWAY",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hive"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hive-HIVEMETASTORE-BASE",
        "displayName" : "Hive Metastore Server Default Group",
        "roleType" : "HIVEMETASTORE",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hive"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hive-HIVESERVER2-BASE",
        "displayName" : "HiveServer2 Default Group",
        "roleType" : "HIVESERVER2",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hive"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hive-WEBHCAT-BASE",
        "displayName" : "WebHCat Server Default Group",
        "roleType" : "WEBHCAT",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hive"
        },
        "config" : {
          "items" : [ ]
        }
      } ],
      "replicationSchedules" : [ ]
    }, {
      "name" : "hue",
      "type" : "HUE",
      "config" : {
        "items" : [ {
          "name" : "hbase_service",
          "value" : "hbase"
        }, {
          "name" : "hive_service",
          "value" : "hive"
        }, {
          "name" : "hue_hbase_thrift",
          "value" : "hbase-HBASETHRIFTSERVER-336eb98913b4a2f17c66196f6b26555f"
        }, {
          "name" : "hue_webhdfs",
          "value" : "hdfs-NAMENODE-336eb98913b4a2f17c66196f6b26555f"
        }, {
          "name" : "oozie_service",
          "value" : "oozie"
        }, {
          "name" : "zookeeper_service",
          "value" : "zookeeper"
        } ]
      },
      "roles" : [ {
        "name" : "hue-HUE_SERVER-336eb98913b4a2f17c66196f6b26555f",
        "type" : "HUE_SERVER",
        "hostRef" : {
          "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
        },
        "config" : {
          "items" : [ {
            "name" : "secret_key",
            "value" : "QVE0LxYap1yFzA2mhGYe34t3c56NUA"
          } ]
        },
        "roleConfigGroupRef" : {
          "roleConfigGroupName" : "hue-HUE_SERVER-BASE"
        }
      } ],
      "displayName" : "Hue",
      "roleConfigGroups" : [ {
        "name" : "hue-HUE_SERVER-BASE",
        "displayName" : "Hue Server Default Group",
        "roleType" : "HUE_SERVER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hue"
        },
        "config" : {
          "items" : [ ]
        }
      }, {
        "name" : "hue-KT_RENEWER-BASE",
        "displayName" : "Kerberos Ticket Renewer Default Group",
        "roleType" : "KT_RENEWER",
        "base" : true,
        "serviceRef" : {
          "clusterName" : "cluster",
          "serviceName" : "hue"
        },
        "config" : {
          "items" : [ ]
        }
      } ]
    } ],
    "parcels" : [ {
      "product" : "CDH",
      "version" : "5.1.2-1.cdh5.1.2.p0.3",
      "stage" : "DISTRIBUTED",
      "clusterRef" : {
        "clusterName" : "cluster"
      }
    }, {
      "product" : "CDH",
      "version" : "5.1.2-1.cdh5.1.2.p0.3",
      "stage" : "ACTIVATED",
      "clusterRef" : {
        "clusterName" : "cluster"
      }
    }, {
      "product" : "CDH",
      "version" : "5.0.2-1.cdh5.0.2.p0.13",
      "stage" : "UNDISTRIBUTING",
      "clusterRef" : {
        "clusterName" : "cluster"
      }
    } ]
  } ],
  "hosts" : [ {
    "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd",
    "ipAddress" : "192.168.35.75",
    "hostname" : "sandy-quad-1.sslab.lan",
    "rackId" : "/default",
    "config" : {
      "items" : [ ]
    }
  }, {
    "hostId" : "ac771927-ccd9-410a-898a-84ba2e28fb20",
    "ipAddress" : "192.168.35.76",
    "hostname" : "sandy-quad-2.sslab.lan",
    "rackId" : "/default",
    "config" : {
      "items" : [ ]
    }
  }, {
    "hostId" : "29459302-a438-4e8f-a49f-37ddead0911c",
    "ipAddress" : "192.168.35.77",
    "hostname" : "sandy-quad-3.sslab.lan",
    "rackId" : "/default",
    "config" : {
      "items" : [ ]
    }
  }, {
    "hostId" : "a5362b28-91ba-4d24-9afc-17b999808208",
    "ipAddress" : "192.168.35.78",
    "hostname" : "sandy-quad-4.sslab.lan",
    "rackId" : "/default",
    "config" : {
      "items" : [ ]
    }
  } ],
  "users" : [ {
    "name" : "__cloudera_internal_user__mgmt-EVENTSERVER-336eb98913b4a2f17c66196f6b26555f",
    "roles" : [ "ROLE_USER" ],
    "pwHash" : "a59b69d6b97c626e6a20a22c07bb806f175fa1c770bc0d96ab656e61024cfd9f",
    "pwSalt" : 458622971772362080,
    "pwLogin" : true
  }, {
    "name" : "__cloudera_internal_user__mgmt-HOSTMONITOR-336eb98913b4a2f17c66196f6b26555f",
    "roles" : [ "ROLE_USER" ],
    "pwHash" : "6cb0757041b3f73326fefa2697606af6a2dd05f81fd53d61c3f6fb95bd4d299b",
    "pwSalt" : -1648359851538215842,
    "pwLogin" : true
  }, {
    "name" : "__cloudera_internal_user__mgmt-SERVICEMONITOR-336eb98913b4a2f17c66196f6b26555f",
    "roles" : [ "ROLE_USER" ],
    "pwHash" : "4de66598e94738424e587e37b33d0fa6c1b6bdc78afc11c37cfd8fb10fafef95",
    "pwSalt" : -8148036027421532821,
    "pwLogin" : true
  }, {
    "name" : "admin",
    "roles" : [ "ROLE_ADMIN" ],
    "pwHash" : "bad887095fd4f14583546ef84b47e93f36a488d5a7fbc93c9dbf4cadbbbf9214",
    "pwSalt" : -9217509567773958374,
    "pwLogin" : true
  } ],
  "versionInfo" : {
    "version" : "5.0.2",
    "buildUser" : "jenkins",
    "buildTimestamp" : "20140606-2222",
    "gitHash" : "80907df78ba6b50c21a598f0caff8b00685d5961",
    "snapshot" : false
  },
  "managementService" : {
    "name" : "mgmt",
    "type" : "MGMT",
    "config" : {
      "items" : [ ]
    },
    "roles" : [ {
      "name" : "mgmt-ALERTPUBLISHER-336eb98913b4a2f17c66196f6b26555f",
      "type" : "ALERTPUBLISHER",
      "hostRef" : {
        "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
      },
      "config" : {
        "items" : [ ]
      },
      "roleConfigGroupRef" : {
        "roleConfigGroupName" : "mgmt-ALERTPUBLISHER-BASE"
      }
    }, {
      "name" : "mgmt-EVENTSERVER-336eb98913b4a2f17c66196f6b26555f",
      "type" : "EVENTSERVER",
      "hostRef" : {
        "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
      },
      "config" : {
        "items" : [ ]
      },
      "roleConfigGroupRef" : {
        "roleConfigGroupName" : "mgmt-EVENTSERVER-BASE"
      }
    }, {
      "name" : "mgmt-HOSTMONITOR-336eb98913b4a2f17c66196f6b26555f",
      "type" : "HOSTMONITOR",
      "hostRef" : {
        "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
      },
      "config" : {
        "items" : [ ]
      },
      "roleConfigGroupRef" : {
        "roleConfigGroupName" : "mgmt-HOSTMONITOR-BASE"
      }
    }, {
      "name" : "mgmt-SERVICEMONITOR-336eb98913b4a2f17c66196f6b26555f",
      "type" : "SERVICEMONITOR",
      "hostRef" : {
        "hostId" : "7b26b50e-aa71-49d9-9ff8-b61f1f87bfdd"
      },
      "config" : {
        "items" : [ ]
      },
      "roleConfigGroupRef" : {
        "roleConfigGroupName" : "mgmt-SERVICEMONITOR-BASE"
      }
    } ],
    "displayName" : "Cloudera Management Service",
    "roleConfigGroups" : [ {
      "name" : "mgmt-ACTIVITYMONITOR-BASE",
      "displayName" : "Activity Monitor Default Group",
      "roleType" : "ACTIVITYMONITOR",
      "base" : true,
      "serviceRef" : {
        "serviceName" : "mgmt"
      },
      "config" : {
        "items" : [ ]
      }
    }, {
      "name" : "mgmt-ALERTPUBLISHER-BASE",
      "displayName" : "Alert Publisher Default Group",
      "roleType" : "ALERTPUBLISHER",
      "base" : true,
      "serviceRef" : {
        "serviceName" : "mgmt"
      },
      "config" : {
        "items" : [ ]
      }
    }, {
      "name" : "mgmt-EVENTSERVER-BASE",
      "displayName" : "Event Server Default Group",
      "roleType" : "EVENTSERVER",
      "base" : true,
      "serviceRef" : {
        "serviceName" : "mgmt"
      },
      "config" : {
        "items" : [ ]
      }
    }, {
      "name" : "mgmt-HOSTMONITOR-BASE",
      "displayName" : "Host Monitor Default Group",
      "roleType" : "HOSTMONITOR",
      "base" : true,
      "serviceRef" : {
        "serviceName" : "mgmt"
      },
      "config" : {
        "items" : [ {
          "name" : "firehose_heapsize",
          "value" : "268435456"
        }, {
          "name" : "firehose_non_java_memory_bytes",
          "value" : "1610612736"
        } ]
      }
    }, {
      "name" : "mgmt-NAVIGATOR-BASE",
      "displayName" : "Navigator Audit Server Default Group",
      "roleType" : "NAVIGATOR",
      "base" : true,
      "serviceRef" : {
        "serviceName" : "mgmt"
      },
      "config" : {
        "items" : [ ]
      }
    }, {
      "name" : "mgmt-NAVIGATORMETASERVER-BASE",
      "displayName" : "Navigator Metadata Server (beta) Default Group",
      "roleType" : "NAVIGATORMETASERVER",
      "base" : true,
      "serviceRef" : {
        "serviceName" : "mgmt"
      },
      "config" : {
        "items" : [ ]
      }
    }, {
      "name" : "mgmt-REPORTSMANAGER-BASE",
      "displayName" : "Reports Manager Default Group",
      "roleType" : "REPORTSMANAGER",
      "base" : true,
      "serviceRef" : {
        "serviceName" : "mgmt"
      },
      "config" : {
        "items" : [ ]
      }
    }, {
      "name" : "mgmt-SERVICEMONITOR-BASE",
      "displayName" : "Service Monitor Default Group",
      "roleType" : "SERVICEMONITOR",
      "base" : true,
      "serviceRef" : {
        "serviceName" : "mgmt"
      },
      "config" : {
        "items" : [ {
          "name" : "firehose_heapsize",
          "value" : "268435456"
        }, {
          "name" : "firehose_non_java_memory_bytes",
          "value" : "1610612736"
        } ]
      }
    } ]
  },
  "managerSettings" : {
    "items" : [ {
      "name" : "CLUSTER_STATS_START",
      "value" : "10/21/2012 11:00"
    }, {
      "name" : "PUBLIC_CLOUD_STATUS",
      "value" : "NOT_ON_PUBLIC_CLOUD"
    }, {
      "name" : "REMOTE_PARCEL_REPO_URLS",
      "value" : "http://archive.cloudera.com/cdh5/parcels/latest/,http://archive.cloudera.com/cdh4/parcels/latest/,ht...
    } ]
  },
  "allHostsConfig" : {
    "items" : [ ]
  },
  "peers" : [ ]
}